-- Logs begin at Mon 2022-08-01 15:36:06 UTC, end at Mon 2022-08-01 16:58:45 UTC. -- Aug 01 16:29:53.121287 dv-cinder-850321-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 01 16:29:53.130416 dv-cinder-850321-2-iscsi devstack@n-api.service[103591]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 01 16:29:53.132242 dv-cinder-850321-2-iscsi devstack@n-api.service[103591]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 1 16:29:53 2022] *** Aug 01 16:29:53.132242 dv-cinder-850321-2-iscsi devstack@n-api.service[103591]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 01 16:29:53.132242 dv-cinder-850321-2-iscsi devstack@n-api.service[103591]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 01 16:29:53.132242 dv-cinder-850321-2-iscsi devstack@n-api.service[103591]: nodename: dv-cinder-850321-2-iscsi Aug 01 16:29:53.132242 dv-cinder-850321-2-iscsi devstack@n-api.service[103591]: machine: x86_64 Aug 01 16:29:53.132242 dv-cinder-850321-2-iscsi devstack@n-api.service[103591]: clock source: unix Aug 01 16:29:53.132242 dv-cinder-850321-2-iscsi devstack@n-api.service[103591]: pcre jit disabled Aug 01 16:29:53.132242 dv-cinder-850321-2-iscsi devstack@n-api.service[103591]: detected number of CPU cores: 4 Aug 01 16:29:53.132242 dv-cinder-850321-2-iscsi devstack@n-api.service[103591]: current working directory: / Aug 01 16:29:53.132242 dv-cinder-850321-2-iscsi devstack@n-api.service[103591]: detected binary path: /usr/bin/uwsgi-core Aug 01 16:29:53.132242 dv-cinder-850321-2-iscsi devstack@n-api.service[103591]: your processes number limit is 47680 Aug 01 16:29:53.133163 dv-cinder-850321-2-iscsi devstack@n-api.service[103591]: your memory page size is 4096 bytes Aug 01 16:29:53.133163 dv-cinder-850321-2-iscsi devstack@n-api.service[103591]: detected max file descriptor number: 2048 Aug 01 16:29:53.133163 dv-cinder-850321-2-iscsi devstack@n-api.service[103591]: lock engine: pthread robust mutexes Aug 01 16:29:53.133163 dv-cinder-850321-2-iscsi devstack@n-api.service[103591]: thunder lock: enabled Aug 01 16:29:53.133163 dv-cinder-850321-2-iscsi devstack@n-api.service[103591]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 01 16:29:53.133163 dv-cinder-850321-2-iscsi devstack@n-api.service[103591]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 01 16:29:53.171259 dv-cinder-850321-2-iscsi devstack@n-api.service[103591]: Python main interpreter initialized at 0x561c077c29c0 Aug 01 16:29:53.171259 dv-cinder-850321-2-iscsi devstack@n-api.service[103591]: python threads support enabled Aug 01 16:29:53.171259 dv-cinder-850321-2-iscsi devstack@n-api.service[103591]: your server socket listen backlog is limited to 100 connections Aug 01 16:29:53.171259 dv-cinder-850321-2-iscsi devstack@n-api.service[103591]: your mercy for graceful operations on workers is 90 seconds Aug 01 16:29:53.171661 dv-cinder-850321-2-iscsi devstack@n-api.service[103591]: mapped 403077 bytes (393 KB) for 2 cores Aug 01 16:29:53.171661 dv-cinder-850321-2-iscsi devstack@n-api.service[103591]: *** Operational MODE: preforking *** Aug 01 16:29:53.171966 dv-cinder-850321-2-iscsi devstack@n-api.service[103591]: *** uWSGI is running in multiple interpreter mode *** Aug 01 16:29:53.171966 dv-cinder-850321-2-iscsi devstack@n-api.service[103591]: spawned uWSGI master process (pid: 103591) Aug 01 16:29:53.172241 dv-cinder-850321-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 01 16:29:53.173820 dv-cinder-850321-2-iscsi devstack@n-api.service[103591]: spawned uWSGI worker 1 (pid: 103592, cores: 1) Aug 01 16:29:53.173820 dv-cinder-850321-2-iscsi devstack@n-api.service[103591]: spawned uWSGI worker 2 (pid: 103593, cores: 1) Aug 01 16:29:53.173820 dv-cinder-850321-2-iscsi devstack@n-api.service[103591]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 01 16:29:53.832366 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 01 16:29:53.833666 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 01 16:29:54.928647 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 16:29:54.928647 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: from cryptography.utils import int_from_bytes Aug 01 16:29:54.929402 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 16:29:54.929402 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: from cryptography.utils import int_from_bytes Aug 01 16:29:54.931631 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 16:29:54.931631 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: from cryptography.utils import int_from_bytes Aug 01 16:29:54.932132 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 16:29:54.932132 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: from cryptography.utils import int_from_bytes Aug 01 16:29:57.429440 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 01 16:29:57.430206 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 01 16:29:57.430303 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 01 16:29:57.430657 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 01 16:29:57.430909 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 01 16:29:57.431291 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.431607 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.431958 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.432274 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.432577 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.432748 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 01 16:29:57.433135 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.433223 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 01 16:29:57.433298 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.433485 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.433584 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 01 16:29:57.433804 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.433903 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 01 16:29:57.434033 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.434131 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 01 16:29:57.434358 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.434510 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.434674 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850321-2-iscsi {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.434775 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.434985 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.435093 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.435282 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.435382 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.435568 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.435665 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.435898 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.435987 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.436192 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.436287 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.436506 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.436599 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.436802 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.436897 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.437146 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.437296 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.437465 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.438477 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.438626 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850321-2-iscsi {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.438756 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.438845 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.438932 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.439021 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.439106 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.439196 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.439288 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.439369 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.439509 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.439593 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.439678 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.439791 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.439903 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.439990 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.440155 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.440372 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.440488 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.440664 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.440800 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850321-2-iscsi {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.440963 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.441101 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.441272 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.441405 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.441609 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.441703 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.441922 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.442104 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.442228 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.442423 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.442538 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.442706 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.442839 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.443019 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.443139 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.443346 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.443439 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.443650 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.443846 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850321-2-iscsi {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.444010 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.444142 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.444304 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.444452 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.444613 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.444871 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.445097 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.445336 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.445438 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.445654 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.445741 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.445960 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.446057 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.446277 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.446382 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.446572 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.446658 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.446869 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.446961 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.447127 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.447222 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.447403 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.447490 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.447717 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.447829 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.448055 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.448144 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.448370 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.448467 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.448617 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.448717 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.448860 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.448992 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.449173 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.449283 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.449491 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.449589 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.449794 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.449880 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.450094 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.450191 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.450392 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.450490 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.450692 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.450785 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.450989 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.451086 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.451286 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.451382 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.451544 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.451630 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.451817 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.451920 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.452137 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.452234 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.452475 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.452607 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.452762 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.452856 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.453066 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.453153 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.453368 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.453456 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.453670 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.453768 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.453974 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.454067 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.454276 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.454372 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.454576 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.454676 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.454878 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.454971 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.455192 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.455279 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.455501 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.455595 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.455838 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.455928 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.456143 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.456236 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.456440 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.456538 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.456844 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.456986 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.457091 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.457180 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.457385 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.457482 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.457722 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.457808 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.458012 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.458099 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.458308 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.458404 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.458606 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.458692 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.458916 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.459009 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.459216 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.459308 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.459516 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.459618 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.459833 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.459934 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.460129 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.460225 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.460512 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.460616 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.460820 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.460930 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.461119 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.461272 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.461417 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.461512 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.461714 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.461819 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.462010 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.462104 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.462312 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.462411 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.462611 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.462756 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.462907 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.463001 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.463216 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.463303 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.463515 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.463610 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.463839 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.463940 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.464138 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.464223 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.464437 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.464540 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.464733 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.464830 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.465032 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.465118 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.465328 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.465422 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.465625 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.465717 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.465922 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.466020 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.466219 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.466314 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.466515 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.466602 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.466827 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.466921 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.467130 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.467222 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.467531 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.467641 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.467724 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.467864 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.468057 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.468155 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.468360 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.468453 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.468659 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.468753 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.468977 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.469067 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.469276 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.469361 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.469576 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.469662 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.469886 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.469972 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.470182 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.470268 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.470481 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.470566 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.470777 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.470875 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.471070 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.471162 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.471359 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.471454 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.471670 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.471806 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.472002 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.472095 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.472303 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.472403 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.472601 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.472696 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.472899 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.472986 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.473197 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.473367 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.473499 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.473586 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.473799 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.473893 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.474100 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.474194 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.474394 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.474490 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.474709 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.474840 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.475026 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.475122 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.475335 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.475422 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.475637 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.475732 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.475990 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.476087 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.476308 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:29:57.476403 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.476647 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.476739 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.476978 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.477066 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.477319 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.477412 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.477632 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.477726 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.477947 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.478041 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.478272 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.478357 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.478586 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.478685 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.478896 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.478980 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.479210 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.479295 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.479512 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.479622 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.479856 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.479999 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.480167 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.480268 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.480477 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.480586 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.480791 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.480900 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.481097 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.481192 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.481424 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.481550 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.481735 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.481838 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.482047 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.482156 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.482359 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.482464 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.482665 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.482768 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.482968 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.483062 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.483272 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.483400 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.483590 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.483703 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.483920 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.484011 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.484233 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.484328 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.484547 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.484634 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.484854 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.484983 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.485161 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.485249 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.485465 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.485559 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.485770 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.485857 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.486076 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.486164 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.486738 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.486843 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.487060 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.487155 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.487394 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.487486 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.487706 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.487823 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.488085 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.488224 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.488363 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.488475 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.488674 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.488769 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.488987 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.489088 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.489299 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.489394 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.489610 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.489697 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.489935 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.490029 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.490240 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.490327 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.490539 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.490625 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.490889 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.491038 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.491164 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.491252 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.491461 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.491660 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.491835 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.491944 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.492146 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.492262 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.492453 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.492553 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.492750 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.492846 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.493053 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.493161 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.493360 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.493446 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.493662 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.493757 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.493978 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.494161 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.494306 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.494403 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.494611 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.494709 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.494913 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.495046 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.495212 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.495298 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.495517 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.495604 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.495836 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.495928 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.496136 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.496308 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.496437 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.496522 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.496739 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.496824 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.497047 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.497145 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.497349 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.497443 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.497651 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.497742 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.497966 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.498062 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.498269 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.498356 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.498571 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.498694 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.498880 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.498980 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.499182 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.499270 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.499495 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.499583 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.499830 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.499919 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.500144 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.500232 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.500452 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.500544 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.500751 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.500838 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.501061 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.501154 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.501365 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.501461 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.501664 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.501752 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.501962 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.502048 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.502264 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.502350 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.502558 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.502646 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.502854 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.502940 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.503170 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.503276 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.503446 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.503540 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.503741 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.503871 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.504075 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.504173 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.504378 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.504464 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.504679 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.504790 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.504976 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.505091 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.505271 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.505364 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.505568 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.505654 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.505871 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.505966 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.506171 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.506258 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.506471 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.506559 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.506777 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.506865 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.507096 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.507236 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.507473 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.507573 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.507805 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.507939 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.508115 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.508243 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.508422 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.508547 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.508728 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.508889 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.509037 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.509193 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.509351 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.509534 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.509659 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.509868 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.509978 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.510186 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.510273 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.510508 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.510603 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.510820 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.510906 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.511133 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.511234 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.511441 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.511530 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.511750 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.511880 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.512084 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.512173 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.512391 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.512479 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.512708 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.512803 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.513017 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.513110 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.513324 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.513420 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.513625 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.513711 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.513925 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.514011 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.514230 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.514318 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.514535 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.514630 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.514835 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.514956 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.515145 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.515279 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.515448 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.515536 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.515771 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.515875 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.516086 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.516180 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.516402 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.516488 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.516706 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.516809 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.517019 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.517113 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.517316 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.517404 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.517623 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.517718 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.517931 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.518018 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.518239 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.518325 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.518551 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.518646 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.518856 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.518946 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.519175 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.519270 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.519482 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.519571 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.519823 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.519914 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.520133 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.520222 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.520446 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.520544 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.520746 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.520833 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.521053 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.521183 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.521363 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.521451 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.521669 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.521757 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.521973 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.522059 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.522271 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.522359 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.522581 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.522677 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.522941 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.523092 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.523242 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.523358 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.523542 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.523651 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.523872 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.523976 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.524178 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.524288 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.524486 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.524581 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.524801 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.524985 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.525114 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.525234 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.525424 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.525531 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.525726 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.525826 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.526042 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.526128 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.526348 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.526433 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.526650 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.526737 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.526950 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.527036 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.527247 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.527341 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.527562 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.527649 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.527895 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.527987 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.528193 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.528290 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.528506 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.528607 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.528809 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.528895 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.529108 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.529194 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.529442 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.529571 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.529721 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.529816 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.530021 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.530120 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.530321 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.530466 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.530621 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.530710 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.530921 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.531016 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.531227 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.531320 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.531532 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.531627 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.531861 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.532006 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.532167 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.532255 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.532477 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.532572 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.532779 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.532878 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.533084 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.533171 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.533389 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.533475 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.533691 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.533797 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.533993 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.534081 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.534298 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.534383 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.534607 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.534918 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.535022 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.535227 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.535335 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.535536 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.535645 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.535880 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.535971 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.536190 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.536278 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.536502 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.536597 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.536812 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.536899 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.537115 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.537208 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.537422 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.537509 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.537740 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.537837 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.538049 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.538307 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.538392 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.538666 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.538810 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.538982 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.539165 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.539390 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.539477 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.539716 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.539859 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.540061 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.540148 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.540364 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.540452 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.540663 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.540751 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.540963 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.541049 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.541273 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.541371 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.541562 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.541658 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.541874 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.541961 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.542175 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.542264 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.542482 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.542584 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.542781 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.542866 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.543086 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.543173 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.543389 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.543485 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.543700 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.543852 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.544005 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.544093 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.544303 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.544399 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.544603 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.544695 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.544906 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.544993 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.545223 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.545331 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.545527 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.545632 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.545835 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.545922 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.546137 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.546225 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.546443 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.546527 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.546757 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.546842 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.547053 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.547139 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.547351 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.547438 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.547649 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.547748 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.547975 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.548074 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.548279 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.548367 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.548577 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.548744 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.548886 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.548980 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.549191 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.549280 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.549498 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.549598 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.549840 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.549926 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.550162 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.550315 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.550462 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.550764 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.550866 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.551062 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.551156 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.551367 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.551464 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.551670 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.551776 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.551995 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.552194 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.552296 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.552497 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.552595 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.552883 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.552969 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.553185 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.553270 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.553486 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.553572 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.553790 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.553911 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.554125 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.554220 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.554440 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.554656 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.554751 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.555034 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.555133 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.555275 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.555370 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.555595 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.555706 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.555918 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.556019 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.556215 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.556310 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.556522 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.556609 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.556827 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.556914 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.557127 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.557213 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.557422 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.557506 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.557727 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.557815 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.558025 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.558111 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.558320 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.558405 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.558626 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.558720 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.558933 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.559020 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.559235 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.559329 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.559537 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.559631 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.559864 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.559956 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.560165 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.560264 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.560462 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.560560 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.560761 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.560849 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.561059 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.561151 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.561352 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.561448 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.561649 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.561745 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.561944 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.562030 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.562240 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.562380 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.562535 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.562622 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.562848 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.562942 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.563149 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.563237 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.563444 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.563530 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.563739 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.563874 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.564058 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.564147 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.564354 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.564438 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.564657 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.564745 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.564959 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.565081 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.565257 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.565351 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.565556 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.565667 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.565879 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.566036 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.566260 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.566359 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.566490 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.566588 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.566793 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.566880 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.567096 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.567181 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.567437 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.567536 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.567738 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.567889 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.568089 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.568184 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.568387 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.568483 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.568686 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.568781 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.569001 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.569130 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.569310 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.569397 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.569614 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.569780 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.570079 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.570176 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.570511 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.570609 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.570805 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.570891 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.571115 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.571232 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.571430 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.571543 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.571734 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.571862 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.572062 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.572169 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.572384 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.572619 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.572708 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.572992 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.573077 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.573310 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.573406 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.573631 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.573717 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.573953 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.574038 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.574256 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.574340 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.574564 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.574650 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.574868 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.574954 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.575173 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.575259 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.575479 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.575670 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.575808 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.576037 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.576182 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.576360 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.576449 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.576708 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.576794 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.577012 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.577107 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.577317 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.577403 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.577620 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.577706 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.577926 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.578021 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.578223 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.578307 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.578520 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.578653 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.578843 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.578962 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.579151 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.579268 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.579450 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.579568 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.579778 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.579903 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.580080 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.580209 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.580387 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.580523 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.580688 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.580836 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.581121 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.581207 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.581433 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.581555 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.581740 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.582025 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.582154 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.582337 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.582423 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.582646 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.582734 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.582947 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.583032 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.583246 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.583334 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.583549 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.583635 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.583891 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.583992 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.584196 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.584328 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.584496 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.584584 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.584797 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.584891 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.585116 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.585212 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.585462 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.585661 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.585802 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.585890 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.586125 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.586241 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.586431 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.586521 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.586732 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.586818 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.587039 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.587197 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.587362 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.587507 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.587667 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.587839 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.588011 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.588163 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.588421 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.588508 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.588734 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.588830 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.589035 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.589124 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.589371 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.589456 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.589677 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.589765 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.590005 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.590093 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.590325 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.590426 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.590633 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.590733 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.590944 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.591030 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.591244 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.591333 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.591553 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.591646 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.591886 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.591977 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.592195 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.592283 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.592512 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.592607 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.592819 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.592904 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.593134 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.593231 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.593437 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.593524 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.593759 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.593855 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.594080 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.594174 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.594392 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.594479 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.594699 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.594794 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.595006 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.595191 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.595305 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.595422 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.595604 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.595734 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.595947 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.596075 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.596244 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.596406 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.596550 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.596709 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.596854 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.597010 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.597158 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.597319 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.597459 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.597639 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.597756 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.597922 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.598074 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.598243 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.598373 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.598545 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.598687 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.598837 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.598995 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.599145 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.599311 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.599452 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.599626 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.599753 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.599953 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.600080 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.600270 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.600401 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.600573 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.600702 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.600869 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.601053 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.601193 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.601420 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.601513 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.601816 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.601902 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.602116 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.602204 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.602431 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.602519 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.602754 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.602841 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.603068 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.603155 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.603368 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.603467 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.603668 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.603823 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.603999 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.604096 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.604330 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.604415 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.604633 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.604727 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.604950 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.605036 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.605245 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.605331 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.605541 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.605638 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.605845 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.605932 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.606142 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.606229 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.606440 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.606569 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.606735 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.606824 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.607038 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.607125 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.607332 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.607433 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.607625 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.607712 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.607945 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.608033 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.608260 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.608348 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.608556 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.608643 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.608871 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.608958 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.609172 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.609260 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.609466 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.609554 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.609762 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.609847 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.610062 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.610149 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.610360 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.610447 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.610680 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.610774 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.610978 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.611064 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.611641 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.611744 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.611975 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.612080 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.612276 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.612372 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.612577 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.612664 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.612877 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.612973 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.613218 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.613306 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.613520 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.613608 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.613851 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.613948 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.614165 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.614253 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.614482 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.614606 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.614791 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.614887 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.615100 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.615188 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.615405 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.615494 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.615714 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.615834 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.616046 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.616142 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.616357 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.616496 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.616742 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.617057 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.617172 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.617374 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.617504 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.617691 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.617830 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.618002 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.618134 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.618319 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.618417 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.618632 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.618736 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.618946 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.619034 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.619297 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.619504 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.619606 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.619861 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.619954 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.620182 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.620269 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.620495 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.620598 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.620809 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.620897 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.621123 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.621210 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.621438 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.621535 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.621751 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.621839 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.622062 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.622157 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.622373 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.622461 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.622681 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.622768 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.623013 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.623101 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.623335 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.623424 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.623637 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.623724 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.623975 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.624075 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.624293 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.624381 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.624604 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.624732 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.624911 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.625086 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.625219 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.625308 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.625527 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.625622 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.625835 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.625925 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.626143 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.626239 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.626448 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.626574 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.626759 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.626883 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.627064 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.627151 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.627372 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.627465 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.627682 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.627845 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.628021 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.628110 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.628335 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.628430 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.628644 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.628730 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.628953 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.629047 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.629265 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.629519 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.629607 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.629838 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.629934 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.630170 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.630265 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.630493 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.630578 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.630813 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.630899 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.631125 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.631212 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.631438 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.631526 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.631777 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.632022 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.632112 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.632442 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.632540 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.632778 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.632873 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.633095 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.633171 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.633396 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.633473 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.633713 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.633809 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.634023 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.634110 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.634325 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.634415 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.634640 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.634727 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.635049 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.635139 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.635363 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.635676 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.635780 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.636008 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.636098 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.636338 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.636428 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.636653 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.636743 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.636959 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.637047 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.637279 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.637368 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.637588 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.637675 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.637905 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.638117 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.638217 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.638466 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.638555 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.638783 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.638870 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.639087 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.639183 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.639394 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.639489 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.639694 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.639835 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.640026 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.640124 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.640331 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.640420 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.640630 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.640716 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.640933 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.641023 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.641232 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.641319 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.641543 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.641638 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.641841 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.641928 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.642141 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.642226 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.642438 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.642532 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.642745 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.642831 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.643041 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.643134 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.643338 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.643441 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.643639 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.643740 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.643957 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.644044 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.644264 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.644367 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.644562 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.644650 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.644862 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.644993 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.645160 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.645256 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.645461 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.645547 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.645757 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.645843 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.646056 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.646155 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.646363 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.646450 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.646674 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.646761 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.646976 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.647104 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.647282 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.647376 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.647584 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.647671 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.647998 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.648091 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.648321 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.648454 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.648627 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.648858 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.648959 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.649216 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.649305 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.649543 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.649631 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.649850 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.650076 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.650166 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.650407 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.650496 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.650722 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.650818 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.651049 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.651144 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.651375 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.651461 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.651675 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.651793 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.652002 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.652090 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.652305 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.652392 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.652624 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.652867 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.652965 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.653204 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.653293 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.653514 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.653609 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.653821 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.653908 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.654125 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.654220 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.654432 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.654528 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.654737 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.654826 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.655039 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.655125 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.655340 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.655435 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.655645 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.655733 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.655979 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.656068 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.656285 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.656382 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.656590 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.656684 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.656894 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.656980 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.657201 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.657289 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.657509 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.657596 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.657817 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.657905 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.658123 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.658220 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.658428 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.658523 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.658735 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.658834 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.659038 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.659134 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.659342 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.659431 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.659645 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.659741 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.659986 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.660075 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.660324 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.660412 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.660644 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.660745 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.660962 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.661058 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.661276 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.661361 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.661588 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.661754 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.661900 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.661989 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.662208 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.662295 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.662516 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.662604 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.662823 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.662911 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.663138 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.663225 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.663501 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.663595 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.663845 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.664051 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.664165 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.664550 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.664649 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.664862 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.664949 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.665180 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.665267 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.665500 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.665589 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.665807 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.665903 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.666126 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.666253 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.666432 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.666545 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.666755 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.666864 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.667024 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.667137 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.667332 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.667447 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.667648 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.667783 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.667994 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.668117 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.668294 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.668415 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.668598 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.668712 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.668904 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.669032 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.669202 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.669315 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.669500 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.669613 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.669797 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.669921 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.670166 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.670286 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.670479 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.670592 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.670781 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.670903 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.671083 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.671195 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.671378 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.671490 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.671678 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.671836 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.672003 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.672092 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.672306 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.672390 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.672608 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.672695 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.672905 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.672982 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.673203 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.673278 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.673499 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.673575 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.673799 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.673874 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.674096 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.674179 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.674395 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.674472 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.674697 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.674774 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.675004 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.675089 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.675307 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.675385 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.675610 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.675686 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.675937 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.676035 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.676248 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.676325 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.676551 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.676635 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.676870 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.676955 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.677183 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.677262 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.677489 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.677565 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.677810 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.677887 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.678114 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.678188 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.678426 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.678516 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.678829 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.678932 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.679137 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.679233 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.679417 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.679562 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.679828 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.679928 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.680143 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.680220 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.680479 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.680576 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.680790 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.680877 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.681103 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.681189 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.681415 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.681512 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.681725 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.681852 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.682036 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.682134 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.682344 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.682438 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.682669 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.682757 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.682979 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.683078 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.683286 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.683383 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.683590 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.683676 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.683921 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.684024 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.684233 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.684330 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.684548 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.684635 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.684857 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.684953 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.685164 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.685252 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.685476 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.685563 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.685783 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.685879 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.686096 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.686190 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.686412 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.686501 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.686717 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.686812 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.687032 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.687165 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.687345 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.687435 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.687656 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.687745 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.688000 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.688100 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.688317 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.688404 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.688645 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.688734 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.688959 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.689045 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.689268 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.689357 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.689571 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.689668 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.689811 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 01 16:29:57.689899 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.690238 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.690554 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.690902 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.691233 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.691550 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.691895 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.692202 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:29:57.692446 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 01 16:29:57.848013 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: INFO dbcounter [None req-33b441a8-8161-4114-880c-f0cceda61ffa None None] Registered counter for database nova_api Aug 01 16:29:57.849504 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: INFO dbcounter [None req-d180e542-d517-40b6-ad90-6276ef3e9ce5 None None] Registered counter for database nova_api Aug 01 16:29:57.870843 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG oslo_db.sqlalchemy.engines [None req-33b441a8-8161-4114-880c-f0cceda61ffa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103592) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 16:29:57.872621 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG oslo_db.sqlalchemy.engines [None req-d180e542-d517-40b6-ad90-6276ef3e9ce5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103593) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 16:29:57.878000 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG dbcounter [-] [103592] Writer thread running {{(pid=103592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 16:29:57.879135 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG dbcounter [-] [103593] Writer thread running {{(pid=103593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 16:29:57.933334 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.context [None req-33b441a8-8161-4114-880c-f0cceda61ffa None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e73af976-0ba6-4137-9c83-d8f1ddc84c77(cell1) {{(pid=103592) load_cells /opt/stack/nova/nova/context.py:464}} Aug 01 16:29:57.934159 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.context [None req-d180e542-d517-40b6-ad90-6276ef3e9ce5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e73af976-0ba6-4137-9c83-d8f1ddc84c77(cell1) {{(pid=103593) load_cells /opt/stack/nova/nova/context.py:464}} Aug 01 16:29:57.937262 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG oslo_concurrency.lockutils [None req-33b441a8-8161-4114-880c-f0cceda61ffa None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103592) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:29:57.938141 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG oslo_concurrency.lockutils [None req-d180e542-d517-40b6-ad90-6276ef3e9ce5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:29:57.938826 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG oslo_concurrency.lockutils [None req-33b441a8-8161-4114-880c-f0cceda61ffa None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103592) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:29:57.939599 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG oslo_concurrency.lockutils [None req-33b441a8-8161-4114-880c-f0cceda61ffa None None] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103592) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:29:57.939745 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG oslo_concurrency.lockutils [None req-d180e542-d517-40b6-ad90-6276ef3e9ce5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:29:57.940526 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG oslo_concurrency.lockutils [None req-d180e542-d517-40b6-ad90-6276ef3e9ce5 None None] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:29:57.941730 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG oslo_concurrency.lockutils [None req-33b441a8-8161-4114-880c-f0cceda61ffa None None] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103592) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:29:57.942512 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG oslo_concurrency.lockutils [None req-d180e542-d517-40b6-ad90-6276ef3e9ce5 None None] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:29:57.943719 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: INFO dbcounter [None req-33b441a8-8161-4114-880c-f0cceda61ffa None None] Registered counter for database nova_cell0 Aug 01 16:29:57.944538 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: INFO dbcounter [None req-d180e542-d517-40b6-ad90-6276ef3e9ce5 None None] Registered counter for database nova_cell0 Aug 01 16:29:57.949413 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: INFO dbcounter [None req-33b441a8-8161-4114-880c-f0cceda61ffa None None] Registered counter for database nova_cell1 Aug 01 16:29:57.950315 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: INFO dbcounter [None req-d180e542-d517-40b6-ad90-6276ef3e9ce5 None None] Registered counter for database nova_cell1 Aug 01 16:29:57.956944 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG oslo_db.sqlalchemy.engines [None req-33b441a8-8161-4114-880c-f0cceda61ffa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103592) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 16:29:57.958524 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG oslo_db.sqlalchemy.engines [None req-d180e542-d517-40b6-ad90-6276ef3e9ce5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103593) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 16:29:57.960606 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG oslo_db.sqlalchemy.engines [None req-33b441a8-8161-4114-880c-f0cceda61ffa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103592) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 16:29:57.963830 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG dbcounter [-] [103593] Writer thread running {{(pid=103593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 16:29:57.963982 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG dbcounter [-] [103592] Writer thread running {{(pid=103592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 16:29:57.964527 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG oslo_db.sqlalchemy.engines [None req-d180e542-d517-40b6-ad90-6276ef3e9ce5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103593) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 16:29:58.107727 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG dbcounter [-] [103592] Writer thread running {{(pid=103592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 16:29:58.109246 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG dbcounter [-] [103593] Writer thread running {{(pid=103593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 16:29:58.118314 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: INFO dbcounter [None req-33b441a8-8161-4114-880c-f0cceda61ffa None None] Registered counter for database nova_cell0 Aug 01 16:29:58.121015 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: INFO dbcounter [None req-d180e542-d517-40b6-ad90-6276ef3e9ce5 None None] Registered counter for database nova_cell0 Aug 01 16:29:58.128446 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG oslo_db.sqlalchemy.engines [None req-33b441a8-8161-4114-880c-f0cceda61ffa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103592) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 16:29:58.132267 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG oslo_db.sqlalchemy.engines [None req-d180e542-d517-40b6-ad90-6276ef3e9ce5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103593) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 16:29:58.133966 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG dbcounter [-] [103592] Writer thread running {{(pid=103592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 16:29:58.137416 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG dbcounter [-] [103593] Writer thread running {{(pid=103593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 16:29:58.478372 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: WARNING keystonemiddleware.auth_token [None req-33b441a8-8161-4114-880c-f0cceda61ffa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 16:29:58.483814 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: WARNING keystonemiddleware.auth_token [None req-d180e542-d517-40b6-ad90-6276ef3e9ce5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 16:29:58.486050 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: WARNING keystonemiddleware.auth_token [None req-33b441a8-8161-4114-880c-f0cceda61ffa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 16:29:58.492981 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: WARNING keystonemiddleware.auth_token [None req-d180e542-d517-40b6-ad90-6276ef3e9ce5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 16:29:58.840913 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: WARNING keystonemiddleware.auth_token [None req-33b441a8-8161-4114-880c-f0cceda61ffa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 16:29:58.843421 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: WARNING keystonemiddleware.auth_token [None req-d180e542-d517-40b6-ad90-6276ef3e9ce5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 16:29:58.846988 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: WARNING keystonemiddleware.auth_token [None req-33b441a8-8161-4114-880c-f0cceda61ffa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 16:29:58.849451 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: WARNING keystonemiddleware.auth_token [None req-d180e542-d517-40b6-ad90-6276ef3e9ce5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 16:29:58.852480 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x561c077c29c0 pid: 103592 (default app) Aug 01 16:29:58.854592 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi [None req-33b441a8-8161-4114-880c-f0cceda61ffa None None] Calling method '>' {{(pid=103592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:29:58.854911 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x561c077c29c0 pid: 103593 (default app) Aug 01 16:29:58.855789 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: INFO nova.api.openstack.requestlog [None req-33b441a8-8161-4114-880c-f0cceda61ffa None None] 10.222.0.45 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001771 Aug 01 16:29:58.856206 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: [pid: 103592|app: 0|req: 1/1] 10.222.0.45 () {50 vars in 788 bytes} [Mon Aug 1 16:29:58 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:31:17.142307 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi [None req-d180e542-d517-40b6-ad90-6276ef3e9ce5 None None] Calling method '>' {{(pid=103593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:31:17.143456 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: INFO nova.api.openstack.requestlog [None req-d180e542-d517-40b6-ad90-6276ef3e9ce5 None None] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002033 Aug 01 16:31:17.143909 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: [pid: 103593|app: 0|req: 1/2] 10.222.0.45 () {54 vars in 930 bytes} [Mon Aug 1 16:31:17 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:31:17.155730 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG dbcounter [-] [103592] Writing DB stats nova_api:SELECT=3 {{(pid=103592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:31:17.156920 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG dbcounter [-] [103592] Writing DB stats nova_cell1:SELECT=3 {{(pid=103592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:31:17.158215 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG dbcounter [-] [103592] Writing DB stats nova_cell0:SELECT=3 {{(pid=103592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:31:17.158960 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG dbcounter [-] [103592] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:31:18.081821 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi [None req-072b8be8-3f91-4da5-998c-89e184d77998 admin admin] Calling method '>' {{(pid=103592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:31:18.115686 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: INFO nova.api.openstack.requestlog [None req-072b8be8-3f91-4da5-998c-89e184d77998 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.965180 Aug 01 16:31:18.116867 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: [pid: 103592|app: 0|req: 2/3] 10.222.0.45 () {60 vars in 1291 bytes} [Mon Aug 1 16:31:17 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:31:20.366566 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi [None req-d180e542-d517-40b6-ad90-6276ef3e9ce5 None None] Calling method '>' {{(pid=103593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:31:20.367601 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: INFO nova.api.openstack.requestlog [None req-d180e542-d517-40b6-ad90-6276ef3e9ce5 None None] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Aug 01 16:31:20.368016 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: [pid: 103593|app: 0|req: 2/4] 10.222.0.45 () {54 vars in 930 bytes} [Mon Aug 1 16:31:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:31:20.836477 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi [None req-128c0416-2432-4961-8495-9eb446d9f7db admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "disk": 1, "ram": 256, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:31:20.857000 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 16:31:20.857000 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: warnings.warn(msg) Aug 01 16:31:20.887225 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: INFO nova.api.openstack.requestlog [None req-128c0416-2432-4961-8495-9eb446d9f7db admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.512200 Aug 01 16:31:20.888032 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: [pid: 103592|app: 0|req: 3/5] 10.222.0.45 () {64 vars in 1282 bytes} [Mon Aug 1 16:31:20 2022] POST /compute/v2.1/flavors => generated 407 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 16:31:20.901422 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG dbcounter [-] [103593] Writing DB stats nova_api:SELECT=3 {{(pid=103593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:31:20.902517 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG dbcounter [-] [103593] Writing DB stats nova_cell0:SELECT=3 {{(pid=103593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:31:20.903467 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG dbcounter [-] [103593] Writing DB stats nova_cell1:SELECT=3 {{(pid=103593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:31:20.904407 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG dbcounter [-] [103593] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:31:21.118640 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi [None req-d5118985-3fe4-4a8a-8776-7d06ee313047 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:31:21.123337 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 16:31:21.123337 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: warnings.warn(msg) Aug 01 16:31:21.187183 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: INFO nova.api.openstack.requestlog [None req-d5118985-3fe4-4a8a-8776-7d06ee313047 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.291160 Aug 01 16:31:21.187866 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: [pid: 103593|app: 0|req: 3/6] 10.222.0.45 () {64 vars in 1335 bytes} [Mon Aug 1 16:31:20 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:31:23.490783 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi [None req-128c0416-2432-4961-8495-9eb446d9f7db admin admin] Calling method '>' {{(pid=103592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:31:23.492018 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: INFO nova.api.openstack.requestlog [None req-128c0416-2432-4961-8495-9eb446d9f7db admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001613 Aug 01 16:31:23.492486 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: [pid: 103592|app: 0|req: 4/7] 10.222.0.45 () {54 vars in 930 bytes} [Mon Aug 1 16:31:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:31:24.172158 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi [None req-47e375d7-a19f-4dee-9c94-32212a9a9c0f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "rxtx_factor": 1.0, "id": "d1", "ram": 512, "disk": 5, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=103593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:31:24.192139 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 16:31:24.192139 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: warnings.warn(msg) Aug 01 16:31:24.215642 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: INFO nova.api.openstack.requestlog [None req-47e375d7-a19f-4dee-9c94-32212a9a9c0f admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.716737 Aug 01 16:31:24.223449 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: [pid: 103593|app: 0|req: 4/8] 10.222.0.45 () {64 vars in 1282 bytes} [Mon Aug 1 16:31:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 16:31:24.229499 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi [None req-a6f8578c-f405-480e-83d0-bb7c10911912 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:31:24.232484 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 16:31:24.232484 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: warnings.warn(msg) Aug 01 16:31:24.270659 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: INFO nova.api.openstack.requestlog [None req-a6f8578c-f405-480e-83d0-bb7c10911912 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045313 Aug 01 16:31:24.277882 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: [pid: 103592|app: 0|req: 5/9] 10.222.0.45 () {64 vars in 1335 bytes} [Mon Aug 1 16:31:24 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:31:26.480047 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi [None req-47e375d7-a19f-4dee-9c94-32212a9a9c0f admin admin] Calling method '>' {{(pid=103593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:31:26.481193 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: INFO nova.api.openstack.requestlog [None req-47e375d7-a19f-4dee-9c94-32212a9a9c0f admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001623 Aug 01 16:31:26.482530 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: [pid: 103593|app: 0|req: 5/10] 10.222.0.45 () {54 vars in 930 bytes} [Mon Aug 1 16:31:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:31:26.905297 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi [None req-002e4f9a-fa9a-4a5a-98e0-0d7181b728cd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "disk": 10, "os-flavor-access:is_public": true, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "id": "d2", "swap": 0}} {{(pid=103592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:31:26.928158 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: INFO nova.api.openstack.requestlog [None req-002e4f9a-fa9a-4a5a-98e0-0d7181b728cd admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.437914 Aug 01 16:31:26.928693 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: [pid: 103592|app: 0|req: 6/11] 10.222.0.45 () {64 vars in 1282 bytes} [Mon Aug 1 16:31:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 16:31:26.942114 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi [None req-187ee9d3-65cc-4b1b-94f4-acfc275ac3ee admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:31:26.970649 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: INFO nova.api.openstack.requestlog [None req-187ee9d3-65cc-4b1b-94f4-acfc275ac3ee admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032350 Aug 01 16:31:26.971263 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: [pid: 103593|app: 0|req: 6/12] 10.222.0.45 () {64 vars in 1335 bytes} [Mon Aug 1 16:31:26 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:31:29.180311 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi [None req-002e4f9a-fa9a-4a5a-98e0-0d7181b728cd admin admin] Calling method '>' {{(pid=103592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:31:29.181413 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: INFO nova.api.openstack.requestlog [None req-002e4f9a-fa9a-4a5a-98e0-0d7181b728cd admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001563 Aug 01 16:31:29.181840 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: [pid: 103592|app: 0|req: 7/13] 10.222.0.45 () {54 vars in 930 bytes} [Mon Aug 1 16:31:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:31:29.653392 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi [None req-6d509b3b-2722-4835-b0b5-599274c3c658 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "d3", "disk": 10, "os-flavor-access:is_public": true, "name": "ds2G", "ram": 2048, "vcpus": 2}} {{(pid=103593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:31:29.673583 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: INFO nova.api.openstack.requestlog [None req-6d509b3b-2722-4835-b0b5-599274c3c658 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.480120 Aug 01 16:31:29.674353 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: [pid: 103593|app: 0|req: 7/14] 10.222.0.45 () {64 vars in 1282 bytes} [Mon Aug 1 16:31:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 16:31:29.688862 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi [None req-5374808f-e854-4e41-8c36-00083eb3e277 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:31:29.717213 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: INFO nova.api.openstack.requestlog [None req-5374808f-e854-4e41-8c36-00083eb3e277 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034298 Aug 01 16:31:29.717800 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: [pid: 103592|app: 0|req: 8/15] 10.222.0.45 () {64 vars in 1335 bytes} [Mon Aug 1 16:31:29 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:31:32.047801 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi [None req-6d509b3b-2722-4835-b0b5-599274c3c658 admin admin] Calling method '>' {{(pid=103593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:31:32.048838 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: INFO nova.api.openstack.requestlog [None req-6d509b3b-2722-4835-b0b5-599274c3c658 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Aug 01 16:31:32.049197 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: [pid: 103593|app: 0|req: 8/16] 10.222.0.45 () {54 vars in 930 bytes} [Mon Aug 1 16:31:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:31:32.511743 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi [None req-749731ae-aa94-443e-b19e-e367beda4045 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "swap": 0, "rxtx_factor": 1.0, "id": "d4", "disk": 20, "os-flavor-access:is_public": true}} {{(pid=103592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:31:32.532276 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: INFO nova.api.openstack.requestlog [None req-749731ae-aa94-443e-b19e-e367beda4045 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.476535 Aug 01 16:31:32.539838 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: [pid: 103592|app: 0|req: 9/17] 10.222.0.45 () {64 vars in 1282 bytes} [Mon Aug 1 16:31:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 16:31:32.546932 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi [None req-c3ab53e3-ad10-4607-985f-f44502efd921 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:31:32.578267 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: INFO nova.api.openstack.requestlog [None req-c3ab53e3-ad10-4607-985f-f44502efd921 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034992 Aug 01 16:31:32.581921 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: [pid: 103593|app: 0|req: 9/18] 10.222.0.45 () {64 vars in 1335 bytes} [Mon Aug 1 16:31:32 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:31:35.003565 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi [None req-749731ae-aa94-443e-b19e-e367beda4045 admin admin] Calling method '>' {{(pid=103592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:31:35.004682 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: INFO nova.api.openstack.requestlog [None req-749731ae-aa94-443e-b19e-e367beda4045 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001609 Aug 01 16:31:35.005090 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: [pid: 103592|app: 0|req: 10/19] 10.222.0.45 () {54 vars in 930 bytes} [Mon Aug 1 16:31:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:31:35.447470 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi [None req-130cb417-9404-4612-8836-23a9e125788f admin admin] Calling method '>' {{(pid=103593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:31:35.472779 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: INFO nova.api.openstack.requestlog [None req-130cb417-9404-4612-8836-23a9e125788f admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.460654 Aug 01 16:31:35.473323 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: [pid: 103593|app: 0|req: 10/20] 10.222.0.45 () {60 vars in 1291 bytes} [Mon Aug 1 16:31:35 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 16:31:37.817581 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi [None req-749731ae-aa94-443e-b19e-e367beda4045 admin admin] Calling method '>' {{(pid=103592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:31:37.818614 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: INFO nova.api.openstack.requestlog [None req-749731ae-aa94-443e-b19e-e367beda4045 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Aug 01 16:31:37.819027 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: [pid: 103592|app: 0|req: 11/21] 10.222.0.45 () {54 vars in 930 bytes} [Mon Aug 1 16:31:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 16:31:38.256346 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi [None req-dfa3b60a-6e59-42c0-845a-a2bd22191ad1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 1, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "ram": 512, "id": "1"}} {{(pid=103593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:31:38.283249 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: INFO nova.api.openstack.requestlog [None req-dfa3b60a-6e59-42c0-845a-a2bd22191ad1 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.456717 Aug 01 16:31:38.284116 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: [pid: 103593|app: 0|req: 11/22] 10.222.0.45 () {64 vars in 1282 bytes} [Mon Aug 1 16:31:37 2022] POST /compute/v2.1/flavors => generated 402 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 16:31:38.299109 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi [None req-09285018-74f7-4266-81f6-35ca0b15999e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:31:38.331155 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: INFO nova.api.openstack.requestlog [None req-09285018-74f7-4266-81f6-35ca0b15999e admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037753 Aug 01 16:31:38.331986 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: [pid: 103592|app: 0|req: 12/23] 10.222.0.45 () {64 vars in 1332 bytes} [Mon Aug 1 16:31:38 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:31:40.576161 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi [None req-dfa3b60a-6e59-42c0-845a-a2bd22191ad1 admin admin] Calling method '>' {{(pid=103593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:31:40.577119 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: INFO nova.api.openstack.requestlog [None req-dfa3b60a-6e59-42c0-845a-a2bd22191ad1 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Aug 01 16:31:40.577844 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: [pid: 103593|app: 0|req: 12/24] 10.222.0.45 () {54 vars in 930 bytes} [Mon Aug 1 16:31:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:31:41.004082 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi [None req-fe94ada5-6a66-431a-858a-8adf48a3e6ca admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.small", "swap": 0, "ram": 2048, "id": "2", "disk": 20, "vcpus": 1}} {{(pid=103592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:31:41.026831 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: INFO nova.api.openstack.requestlog [None req-fe94ada5-6a66-431a-858a-8adf48a3e6ca admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.442463 Aug 01 16:31:41.027532 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: [pid: 103592|app: 0|req: 13/25] 10.222.0.45 () {64 vars in 1282 bytes} [Mon Aug 1 16:31:40 2022] POST /compute/v2.1/flavors => generated 405 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 16:31:41.039737 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi [None req-c74b63d6-0ddb-4090-a45a-0fa19bdd5ea0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:31:41.066831 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: INFO nova.api.openstack.requestlog [None req-c74b63d6-0ddb-4090-a45a-0fa19bdd5ea0 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030952 Aug 01 16:31:41.067449 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: [pid: 103593|app: 0|req: 13/26] 10.222.0.45 () {64 vars in 1332 bytes} [Mon Aug 1 16:31:41 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:31:43.286914 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi [None req-fe94ada5-6a66-431a-858a-8adf48a3e6ca admin admin] Calling method '>' {{(pid=103592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:31:43.288658 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: INFO nova.api.openstack.requestlog [None req-fe94ada5-6a66-431a-858a-8adf48a3e6ca admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002195 Aug 01 16:31:43.289319 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: [pid: 103592|app: 0|req: 14/27] 10.222.0.45 () {54 vars in 930 bytes} [Mon Aug 1 16:31:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:31:43.680964 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi [None req-7a24f774-7175-4d2b-8d16-5ad078eee509 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "swap": 0, "os-flavor-access:is_public": true, "ram": 4096, "name": "m1.medium", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "3"}} {{(pid=103593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:31:43.701212 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: INFO nova.api.openstack.requestlog [None req-7a24f774-7175-4d2b-8d16-5ad078eee509 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.405065 Aug 01 16:31:43.702036 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: [pid: 103593|app: 0|req: 14/28] 10.222.0.45 () {64 vars in 1282 bytes} [Mon Aug 1 16:31:43 2022] POST /compute/v2.1/flavors => generated 406 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 16:31:43.714404 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi [None req-64412e84-f84e-483c-8186-0204925d9d93 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:31:43.740708 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: INFO nova.api.openstack.requestlog [None req-64412e84-f84e-483c-8186-0204925d9d93 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030158 Aug 01 16:31:43.741428 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: [pid: 103592|app: 0|req: 15/29] 10.222.0.45 () {64 vars in 1332 bytes} [Mon Aug 1 16:31:43 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:31:46.024695 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi [None req-7a24f774-7175-4d2b-8d16-5ad078eee509 admin admin] Calling method '>' {{(pid=103593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:31:46.026002 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: INFO nova.api.openstack.requestlog [None req-7a24f774-7175-4d2b-8d16-5ad078eee509 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001626 Aug 01 16:31:46.026544 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: [pid: 103593|app: 0|req: 15/30] 10.222.0.45 () {54 vars in 930 bytes} [Mon Aug 1 16:31:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:31:46.722189 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi [None req-c298f5ab-330f-4258-ab1f-403b76ced7a9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "vcpus": 4, "name": "m1.large", "disk": 80, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=103592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:31:46.753225 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: INFO nova.api.openstack.requestlog [None req-c298f5ab-330f-4258-ab1f-403b76ced7a9 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.717153 Aug 01 16:31:46.754064 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: [pid: 103592|app: 0|req: 16/31] 10.222.0.45 () {64 vars in 1282 bytes} [Mon Aug 1 16:31:46 2022] POST /compute/v2.1/flavors => generated 405 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 16:31:46.767369 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi [None req-03165046-defb-4b6c-81a9-56fec7b9642f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:31:46.794842 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: INFO nova.api.openstack.requestlog [None req-03165046-defb-4b6c-81a9-56fec7b9642f admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031289 Aug 01 16:31:46.795592 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: [pid: 103593|app: 0|req: 16/32] 10.222.0.45 () {64 vars in 1332 bytes} [Mon Aug 1 16:31:46 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:31:49.024213 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi [None req-c298f5ab-330f-4258-ab1f-403b76ced7a9 admin admin] Calling method '>' {{(pid=103592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:31:49.025368 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: INFO nova.api.openstack.requestlog [None req-c298f5ab-330f-4258-ab1f-403b76ced7a9 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001701 Aug 01 16:31:49.025846 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: [pid: 103592|app: 0|req: 17/33] 10.222.0.45 () {54 vars in 930 bytes} [Mon Aug 1 16:31:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:31:49.482373 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi [None req-98be35f9-94c4-4d55-a05a-5de5971de858 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "os-flavor-access:is_public": true, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "id": "5", "rxtx_factor": 1.0, "swap": 0, "vcpus": 8}} {{(pid=103593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:31:49.505803 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: INFO nova.api.openstack.requestlog [None req-98be35f9-94c4-4d55-a05a-5de5971de858 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.471448 Aug 01 16:31:49.506363 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: [pid: 103593|app: 0|req: 17/34] 10.222.0.45 () {64 vars in 1282 bytes} [Mon Aug 1 16:31:49 2022] POST /compute/v2.1/flavors => generated 408 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 16:31:49.518708 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi [None req-5a5339c2-45a5-4f42-b40e-7a01f169c260 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:31:49.525603 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG dbcounter [-] [103592] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:31:49.548230 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: INFO nova.api.openstack.requestlog [None req-5a5339c2-45a5-4f42-b40e-7a01f169c260 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033279 Aug 01 16:31:49.564217 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: [pid: 103592|app: 0|req: 18/35] 10.222.0.45 () {64 vars in 1332 bytes} [Mon Aug 1 16:31:49 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:32:09.723014 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi [None req-98be35f9-94c4-4d55-a05a-5de5971de858 admin admin] Calling method '>' {{(pid=103593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:32:09.724078 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: INFO nova.api.openstack.requestlog [None req-98be35f9-94c4-4d55-a05a-5de5971de858 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001523 Aug 01 16:32:09.724469 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: [pid: 103593|app: 0|req: 18/36] 10.222.0.45 () {54 vars in 930 bytes} [Mon Aug 1 16:32:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:32:10.159321 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi [None req-961bd80e-199d-41ca-891b-0bbeef0ddae2 admin admin] Calling method '>' {{(pid=103592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:32:10.179140 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: INFO nova.api.openstack.requestlog [None req-961bd80e-199d-41ca-891b-0bbeef0ddae2 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.447407 Aug 01 16:32:10.179683 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: [pid: 103592|app: 0|req: 19/37] 10.222.0.45 () {60 vars in 1291 bytes} [Mon Aug 1 16:32:09 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:32:11.324461 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi [None req-98be35f9-94c4-4d55-a05a-5de5971de858 admin admin] Calling method '>' {{(pid=103593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:32:11.325486 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: INFO nova.api.openstack.requestlog [None req-98be35f9-94c4-4d55-a05a-5de5971de858 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001554 Aug 01 16:32:11.325894 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: [pid: 103593|app: 0|req: 19/38] 10.222.0.45 () {56 vars in 1074 bytes} [Mon Aug 1 16:32:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:32:11.904838 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi [None req-45a2c528-ce13-4439-bc77-6229cfd94293 admin admin] Calling method '>' {{(pid=103592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:32:11.911797 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: INFO nova.api.openstack.wsgi [None req-45a2c528-ce13-4439-bc77-6229cfd94293 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 01 16:32:11.915172 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi [None req-45a2c528-ce13-4439-bc77-6229cfd94293 admin admin] Request method failure captured: Aug 01 16:32:11.915172 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 01 16:32:11.915172 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: Accept: application/json Aug 01 16:32:11.915172 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: Accept-Encoding: gzip, deflate Aug 01 16:32:11.915172 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: Connection: keep-alive Aug 01 16:32:11.915172 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: Content-Length: 0 Aug 01 16:32:11.915172 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: Host: 10.222.0.45 Aug 01 16:32:11.915172 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: Openstack-Api-Version: compute 2.90 Aug 01 16:32:11.915172 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: Openstack-System-Scope: None Aug 01 16:32:11.915172 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: User-Agent: python-novaclient Aug 01 16:32:11.915172 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: X-Auth-Token: gAAAAABi6AAL7XUT5ex30fQai19nbzhAy3vrb0AvaOrRyoep4zrqCO1v25MtZ89NmEGHajjs5yGAICS7oGwA25M3iG1NFiKj1cr_fibl_D7RayEoyJS3Odr-ga8cwdCSNJzm3vAKbkMmwG8JofUwmpnyO938IjATOtjctfvGwxlrU2PoH45JyFM Aug 01 16:32:11.915172 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: X-Domain-Id: None Aug 01 16:32:11.915172 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: X-Domain-Name: None Aug 01 16:32:11.915172 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: X-Identity-Status: Confirmed Aug 01 16:32:11.915172 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: X-Is-Admin-Project: True Aug 01 16:32:11.915172 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: X-Openstack-Nova-Api-Version: 2.90 Aug 01 16:32:11.915172 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: X-Project-Domain-Id: default Aug 01 16:32:11.915172 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: X-Project-Domain-Name: Default Aug 01 16:32:11.915172 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: X-Project-Id: 0c8a8aa32f9a4584972956058f337380 Aug 01 16:32:11.915172 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: X-Project-Name: admin Aug 01 16:32:11.915172 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: X-Role: reader,member,admin Aug 01 16:32:11.915172 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: X-Roles: reader,member,admin Aug 01 16:32:11.916760 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_0c8a8aa32f9a4584972956058f337380"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/0c8a8aa32f9a4584972956058f337380"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0c8a8aa32f9a4584972956058f337380"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0c8a8aa32f9a4584972956058f337380"}]}] Aug 01 16:32:11.916760 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: X-Tenant: admin Aug 01 16:32:11.916760 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: X-Tenant-Id: 0c8a8aa32f9a4584972956058f337380 Aug 01 16:32:11.916760 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: X-Tenant-Name: admin Aug 01 16:32:11.916760 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: X-User: admin Aug 01 16:32:11.916760 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: X-User-Domain-Id: default Aug 01 16:32:11.916760 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: X-User-Domain-Name: Default Aug 01 16:32:11.916760 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: X-User-Id: cc7787b19b7142fdb85a77e20df6ff3d Aug 01 16:32:11.916760 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: X-User-Name: admin Aug 01 16:32:11.916760 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: method: > Aug 01 16:32:11.916760 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: exception: Flavor 42 could not be found. Aug 01 16:32:11.916760 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: action_args: {'id': '42'} Aug 01 16:32:11.916760 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: {{(pid=103592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:32:11.916760 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:32:11.917755 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 01 16:32:11.917755 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 01 16:32:11.917755 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 01 16:32:11.917755 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 01 16:32:11.917755 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 16:32:11.917755 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 16:32:11.917755 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 01 16:32:11.917755 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 01 16:32:11.917755 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 01 16:32:11.917755 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:32:11.917755 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 01 16:32:11.917755 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 01 16:32:11.917755 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 01 16:32:11.917755 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi Aug 01 16:32:11.917755 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:32:11.917755 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi Aug 01 16:32:11.917755 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:32:11.917755 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:32:11.917755 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:32:11.919123 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:32:11.919123 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:32:11.919123 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:32:11.919123 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:32:11.919123 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 01 16:32:11.919123 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:32:11.919123 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 01 16:32:11.919123 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi Aug 01 16:32:11.919123 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:32:11.919123 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi Aug 01 16:32:11.919123 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:32:11.919123 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:32:11.919123 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:32:11.919123 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:32:11.919123 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:32:11.919123 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 01 16:32:11.919123 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi Aug 01 16:32:11.919123 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi [None req-45a2c528-ce13-4439-bc77-6229cfd94293 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103592) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:32:11.920326 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: INFO nova.api.openstack.requestlog [None req-45a2c528-ce13-4439-bc77-6229cfd94293 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.447360 Aug 01 16:32:11.920326 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: [pid: 103592|app: 0|req: 20/39] 10.222.0.45 () {60 vars in 1190 bytes} [Mon Aug 1 16:32:11 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 449 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 01 16:32:11.926646 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi [None req-d61bc15a-331a-4e4e-8de4-45001aa1e043 admin admin] Calling method '>' {{(pid=103593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:32:11.930990 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG dbcounter [-] [103593] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:32:11.951224 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: INFO nova.api.openstack.requestlog [None req-d61bc15a-331a-4e4e-8de4-45001aa1e043 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028088 Aug 01 16:32:11.951838 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: [pid: 103593|app: 0|req: 20/40] 10.222.0.45 () {60 vars in 1210 bytes} [Mon Aug 1 16:32:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:32:11.962175 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi [None req-7a288955-539e-4a48-b25e-7a180e45df90 admin admin] Calling method '>' {{(pid=103592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:32:11.987537 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: INFO nova.api.openstack.requestlog [None req-7a288955-539e-4a48-b25e-7a180e45df90 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028629 Aug 01 16:32:11.988168 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: [pid: 103592|app: 0|req: 21/41] 10.222.0.45 () {60 vars in 1210 bytes} [Mon Aug 1 16:32:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:32:11.999210 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi [None req-d8887334-857a-45fd-81fb-573493394983 admin admin] Calling method '>' {{(pid=103593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:32:12.005878 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: INFO nova.api.openstack.wsgi [None req-d8887334-857a-45fd-81fb-573493394983 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 01 16:32:12.009231 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi [None req-d8887334-857a-45fd-81fb-573493394983 admin admin] Request method failure captured: Aug 01 16:32:12.009231 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 01 16:32:12.009231 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: Accept: application/json Aug 01 16:32:12.009231 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: Accept-Encoding: gzip, deflate Aug 01 16:32:12.009231 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: Connection: keep-alive Aug 01 16:32:12.009231 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: Content-Length: 0 Aug 01 16:32:12.009231 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: Host: 10.222.0.45 Aug 01 16:32:12.009231 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: Openstack-Api-Version: compute 2.90 Aug 01 16:32:12.009231 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: Openstack-System-Scope: None Aug 01 16:32:12.009231 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: User-Agent: python-novaclient Aug 01 16:32:12.009231 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: X-Auth-Token: gAAAAABi6AAL7XUT5ex30fQai19nbzhAy3vrb0AvaOrRyoep4zrqCO1v25MtZ89NmEGHajjs5yGAICS7oGwA25M3iG1NFiKj1cr_fibl_D7RayEoyJS3Odr-ga8cwdCSNJzm3vAKbkMmwG8JofUwmpnyO938IjATOtjctfvGwxlrU2PoH45JyFM Aug 01 16:32:12.009231 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: X-Domain-Id: None Aug 01 16:32:12.009231 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: X-Domain-Name: None Aug 01 16:32:12.009231 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: X-Identity-Status: Confirmed Aug 01 16:32:12.009231 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: X-Is-Admin-Project: True Aug 01 16:32:12.009231 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: X-Openstack-Nova-Api-Version: 2.90 Aug 01 16:32:12.009231 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: X-Project-Domain-Id: default Aug 01 16:32:12.009231 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: X-Project-Domain-Name: Default Aug 01 16:32:12.009231 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: X-Project-Id: 0c8a8aa32f9a4584972956058f337380 Aug 01 16:32:12.009231 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: X-Project-Name: admin Aug 01 16:32:12.009231 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: X-Role: reader,member,admin Aug 01 16:32:12.009231 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: X-Roles: reader,member,admin Aug 01 16:32:12.011260 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_0c8a8aa32f9a4584972956058f337380"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/0c8a8aa32f9a4584972956058f337380"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0c8a8aa32f9a4584972956058f337380"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0c8a8aa32f9a4584972956058f337380"}]}] Aug 01 16:32:12.011260 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: X-Tenant: admin Aug 01 16:32:12.011260 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: X-Tenant-Id: 0c8a8aa32f9a4584972956058f337380 Aug 01 16:32:12.011260 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: X-Tenant-Name: admin Aug 01 16:32:12.011260 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: X-User: admin Aug 01 16:32:12.011260 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: X-User-Domain-Id: default Aug 01 16:32:12.011260 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: X-User-Domain-Name: Default Aug 01 16:32:12.011260 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: X-User-Id: cc7787b19b7142fdb85a77e20df6ff3d Aug 01 16:32:12.011260 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: X-User-Name: admin Aug 01 16:32:12.011260 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: method: > Aug 01 16:32:12.011260 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: exception: Flavor 42 could not be found. Aug 01 16:32:12.011260 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: action_args: {'id': '42'} Aug 01 16:32:12.011260 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: {{(pid=103593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:32:12.011260 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:32:12.012399 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 01 16:32:12.012399 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 01 16:32:12.012399 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 01 16:32:12.012399 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 01 16:32:12.012399 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 16:32:12.012399 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 16:32:12.012399 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 01 16:32:12.012399 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 01 16:32:12.012399 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 01 16:32:12.012399 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:32:12.012399 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 01 16:32:12.012399 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 01 16:32:12.012399 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 01 16:32:12.012399 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi Aug 01 16:32:12.012399 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:32:12.012399 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi Aug 01 16:32:12.012399 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:32:12.012399 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:32:12.012399 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:32:12.013468 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:32:12.013468 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:32:12.013468 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:32:12.013468 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:32:12.013468 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 01 16:32:12.013468 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:32:12.013468 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 01 16:32:12.013468 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi Aug 01 16:32:12.013468 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:32:12.013468 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi Aug 01 16:32:12.013468 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:32:12.013468 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:32:12.013468 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:32:12.013468 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:32:12.013468 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:32:12.013468 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 01 16:32:12.013468 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi Aug 01 16:32:12.013468 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi [None req-d8887334-857a-45fd-81fb-573493394983 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:32:12.014863 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: INFO nova.api.openstack.requestlog [None req-d8887334-857a-45fd-81fb-573493394983 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016636 Aug 01 16:32:12.014863 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: [pid: 103593|app: 0|req: 21/42] 10.222.0.45 () {60 vars in 1190 bytes} [Mon Aug 1 16:32:11 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 01 16:32:13.020778 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi [None req-7a288955-539e-4a48-b25e-7a180e45df90 admin admin] Calling method '>' {{(pid=103592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:32:13.021793 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: INFO nova.api.openstack.requestlog [None req-7a288955-539e-4a48-b25e-7a180e45df90 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Aug 01 16:32:13.022200 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: [pid: 103592|app: 0|req: 22/43] 10.222.0.45 () {56 vars in 1074 bytes} [Mon Aug 1 16:32:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:32:13.601077 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi [None req-df9af424-251f-4f0f-88c7-6f0106618fe6 admin admin] Calling method '>' {{(pid=103593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:32:13.606728 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: INFO nova.api.openstack.wsgi [None req-df9af424-251f-4f0f-88c7-6f0106618fe6 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 01 16:32:13.608283 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi [None req-df9af424-251f-4f0f-88c7-6f0106618fe6 admin admin] Request method failure captured: Aug 01 16:32:13.608283 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 01 16:32:13.608283 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: Accept: application/json Aug 01 16:32:13.608283 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: Accept-Encoding: gzip, deflate Aug 01 16:32:13.608283 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: Connection: keep-alive Aug 01 16:32:13.608283 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: Content-Length: 0 Aug 01 16:32:13.608283 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: Host: 10.222.0.45 Aug 01 16:32:13.608283 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: Openstack-Api-Version: compute 2.90 Aug 01 16:32:13.608283 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: Openstack-System-Scope: None Aug 01 16:32:13.608283 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: User-Agent: python-novaclient Aug 01 16:32:13.608283 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: X-Auth-Token: gAAAAABi6AAMCuq3GLV6W9c_-zL3-W1r7s3xxeoFchaWdFXH3aLXgzcfs2w2HxrWHb5W_58SMqv9EXP9_9JUXyFuP-NPFNazvNmSuvTmpMARKFJVW6saBfFAdoOPYAx8oW6htZE7sfsRyi638luhDMYN9vAdt9TYtFJQasGlEHLLf1asViWoLmQ Aug 01 16:32:13.608283 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: X-Domain-Id: None Aug 01 16:32:13.608283 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: X-Domain-Name: None Aug 01 16:32:13.608283 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: X-Identity-Status: Confirmed Aug 01 16:32:13.608283 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: X-Is-Admin-Project: True Aug 01 16:32:13.608283 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: X-Openstack-Nova-Api-Version: 2.90 Aug 01 16:32:13.608283 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: X-Project-Domain-Id: default Aug 01 16:32:13.608283 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: X-Project-Domain-Name: Default Aug 01 16:32:13.608283 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: X-Project-Id: 0c8a8aa32f9a4584972956058f337380 Aug 01 16:32:13.608283 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: X-Project-Name: admin Aug 01 16:32:13.608283 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: X-Role: reader,member,admin Aug 01 16:32:13.608283 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: X-Roles: reader,member,admin Aug 01 16:32:13.609718 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_0c8a8aa32f9a4584972956058f337380"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/0c8a8aa32f9a4584972956058f337380"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0c8a8aa32f9a4584972956058f337380"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0c8a8aa32f9a4584972956058f337380"}]}] Aug 01 16:32:13.609718 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: X-Tenant: admin Aug 01 16:32:13.609718 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: X-Tenant-Id: 0c8a8aa32f9a4584972956058f337380 Aug 01 16:32:13.609718 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: X-Tenant-Name: admin Aug 01 16:32:13.609718 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: X-User: admin Aug 01 16:32:13.609718 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: X-User-Domain-Id: default Aug 01 16:32:13.609718 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: X-User-Domain-Name: Default Aug 01 16:32:13.609718 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: X-User-Id: cc7787b19b7142fdb85a77e20df6ff3d Aug 01 16:32:13.609718 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: X-User-Name: admin Aug 01 16:32:13.609718 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: method: > Aug 01 16:32:13.609718 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: exception: Flavor 84 could not be found. Aug 01 16:32:13.609718 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: action_args: {'id': '84'} Aug 01 16:32:13.609718 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: {{(pid=103593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:32:13.609718 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:32:13.610537 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 01 16:32:13.610537 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 01 16:32:13.610537 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 01 16:32:13.610537 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 01 16:32:13.610537 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 16:32:13.610537 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 16:32:13.610537 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 01 16:32:13.610537 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 01 16:32:13.610537 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 01 16:32:13.610537 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:32:13.610537 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 01 16:32:13.610537 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 01 16:32:13.610537 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 01 16:32:13.610537 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi Aug 01 16:32:13.610537 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:32:13.610537 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi Aug 01 16:32:13.610537 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:32:13.610537 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:32:13.610537 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:32:13.611745 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:32:13.611745 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:32:13.611745 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:32:13.611745 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:32:13.611745 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 01 16:32:13.611745 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:32:13.611745 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 01 16:32:13.611745 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi Aug 01 16:32:13.611745 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:32:13.611745 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi Aug 01 16:32:13.611745 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:32:13.611745 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:32:13.611745 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:32:13.611745 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:32:13.611745 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:32:13.611745 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 01 16:32:13.611745 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi Aug 01 16:32:13.611745 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi [None req-df9af424-251f-4f0f-88c7-6f0106618fe6 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:32:13.613454 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: INFO nova.api.openstack.requestlog [None req-df9af424-251f-4f0f-88c7-6f0106618fe6 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.450479 Aug 01 16:32:13.613454 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: [pid: 103593|app: 0|req: 22/44] 10.222.0.45 () {60 vars in 1190 bytes} [Mon Aug 1 16:32:13 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 452 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 01 16:32:13.622751 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi [None req-7607f4c8-4bcc-4805-8bb9-fcc48b93a9ba admin admin] Calling method '>' {{(pid=103592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:32:13.638753 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: INFO nova.api.openstack.requestlog [None req-7607f4c8-4bcc-4805-8bb9-fcc48b93a9ba admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019627 Aug 01 16:32:13.639369 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: [pid: 103592|app: 0|req: 23/45] 10.222.0.45 () {60 vars in 1210 bytes} [Mon Aug 1 16:32:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 16:32:13.649867 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi [None req-ba56d863-4b2f-48af-b3f2-9673ac4af608 admin admin] Calling method '>' {{(pid=103593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:32:13.665444 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: INFO nova.api.openstack.requestlog [None req-ba56d863-4b2f-48af-b3f2-9673ac4af608 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019142 Aug 01 16:32:13.666051 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: [pid: 103593|app: 0|req: 23/46] 10.222.0.45 () {60 vars in 1210 bytes} [Mon Aug 1 16:32:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:32:13.676349 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi [None req-1f56376e-dd50-43dc-99d0-7f173d8ae088 admin admin] Calling method '>' {{(pid=103592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:32:13.682376 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: INFO nova.api.openstack.wsgi [None req-1f56376e-dd50-43dc-99d0-7f173d8ae088 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 01 16:32:13.683976 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi [None req-1f56376e-dd50-43dc-99d0-7f173d8ae088 admin admin] Request method failure captured: Aug 01 16:32:13.683976 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 01 16:32:13.683976 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: Accept: application/json Aug 01 16:32:13.683976 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: Accept-Encoding: gzip, deflate Aug 01 16:32:13.683976 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: Connection: keep-alive Aug 01 16:32:13.683976 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: Content-Length: 0 Aug 01 16:32:13.683976 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: Host: 10.222.0.45 Aug 01 16:32:13.683976 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: Openstack-Api-Version: compute 2.90 Aug 01 16:32:13.683976 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: Openstack-System-Scope: None Aug 01 16:32:13.683976 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: User-Agent: python-novaclient Aug 01 16:32:13.683976 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: X-Auth-Token: gAAAAABi6AAMCuq3GLV6W9c_-zL3-W1r7s3xxeoFchaWdFXH3aLXgzcfs2w2HxrWHb5W_58SMqv9EXP9_9JUXyFuP-NPFNazvNmSuvTmpMARKFJVW6saBfFAdoOPYAx8oW6htZE7sfsRyi638luhDMYN9vAdt9TYtFJQasGlEHLLf1asViWoLmQ Aug 01 16:32:13.683976 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: X-Domain-Id: None Aug 01 16:32:13.683976 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: X-Domain-Name: None Aug 01 16:32:13.683976 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: X-Identity-Status: Confirmed Aug 01 16:32:13.683976 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: X-Is-Admin-Project: True Aug 01 16:32:13.683976 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: X-Openstack-Nova-Api-Version: 2.90 Aug 01 16:32:13.683976 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: X-Project-Domain-Id: default Aug 01 16:32:13.683976 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: X-Project-Domain-Name: Default Aug 01 16:32:13.683976 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: X-Project-Id: 0c8a8aa32f9a4584972956058f337380 Aug 01 16:32:13.683976 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: X-Project-Name: admin Aug 01 16:32:13.683976 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: X-Role: reader,member,admin Aug 01 16:32:13.683976 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: X-Roles: reader,member,admin Aug 01 16:32:13.685487 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_0c8a8aa32f9a4584972956058f337380"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/0c8a8aa32f9a4584972956058f337380"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0c8a8aa32f9a4584972956058f337380"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0c8a8aa32f9a4584972956058f337380"}]}] Aug 01 16:32:13.685487 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: X-Tenant: admin Aug 01 16:32:13.685487 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: X-Tenant-Id: 0c8a8aa32f9a4584972956058f337380 Aug 01 16:32:13.685487 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: X-Tenant-Name: admin Aug 01 16:32:13.685487 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: X-User: admin Aug 01 16:32:13.685487 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: X-User-Domain-Id: default Aug 01 16:32:13.685487 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: X-User-Domain-Name: Default Aug 01 16:32:13.685487 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: X-User-Id: cc7787b19b7142fdb85a77e20df6ff3d Aug 01 16:32:13.685487 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: X-User-Name: admin Aug 01 16:32:13.685487 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: method: > Aug 01 16:32:13.685487 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: exception: Flavor 84 could not be found. Aug 01 16:32:13.685487 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: action_args: {'id': '84'} Aug 01 16:32:13.685487 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: {{(pid=103592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:32:13.685487 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:32:13.686329 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 01 16:32:13.686329 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 01 16:32:13.686329 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 01 16:32:13.686329 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 01 16:32:13.686329 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 16:32:13.686329 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 16:32:13.686329 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 01 16:32:13.686329 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 01 16:32:13.686329 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 01 16:32:13.686329 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:32:13.686329 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 01 16:32:13.686329 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 01 16:32:13.686329 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 01 16:32:13.686329 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi Aug 01 16:32:13.686329 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:32:13.686329 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi Aug 01 16:32:13.686329 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:32:13.686329 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:32:13.686329 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:32:13.687384 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:32:13.687384 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:32:13.687384 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:32:13.687384 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:32:13.687384 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 01 16:32:13.687384 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:32:13.687384 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 01 16:32:13.687384 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi Aug 01 16:32:13.687384 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:32:13.687384 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi Aug 01 16:32:13.687384 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:32:13.687384 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:32:13.687384 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:32:13.687384 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:32:13.687384 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:32:13.687384 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 01 16:32:13.687384 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi Aug 01 16:32:13.687384 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi [None req-1f56376e-dd50-43dc-99d0-7f173d8ae088 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103592) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:32:13.688451 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: INFO nova.api.openstack.requestlog [None req-1f56376e-dd50-43dc-99d0-7f173d8ae088 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012800 Aug 01 16:32:13.688451 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: [pid: 103592|app: 0|req: 24/47] 10.222.0.45 () {60 vars in 1190 bytes} [Mon Aug 1 16:32:13 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 01 16:32:14.692333 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi [None req-ba56d863-4b2f-48af-b3f2-9673ac4af608 admin admin] Calling method '>' {{(pid=103593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:32:14.693351 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: INFO nova.api.openstack.requestlog [None req-ba56d863-4b2f-48af-b3f2-9673ac4af608 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001523 Aug 01 16:32:14.693759 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: [pid: 103593|app: 0|req: 24/48] 10.222.0.45 () {56 vars in 1074 bytes} [Mon Aug 1 16:32:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:32:15.271223 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi [None req-68cfd851-3205-4d06-a0d4-b84c5a739f0d admin admin] Calling method '>' {{(pid=103592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:32:15.277654 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: INFO nova.api.openstack.wsgi [None req-68cfd851-3205-4d06-a0d4-b84c5a739f0d admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 01 16:32:15.279174 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi [None req-68cfd851-3205-4d06-a0d4-b84c5a739f0d admin admin] Request method failure captured: Aug 01 16:32:15.279174 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 01 16:32:15.279174 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: Accept: application/json Aug 01 16:32:15.279174 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: Accept-Encoding: gzip, deflate Aug 01 16:32:15.279174 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: Connection: keep-alive Aug 01 16:32:15.279174 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: Content-Length: 0 Aug 01 16:32:15.279174 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: Host: 10.222.0.45 Aug 01 16:32:15.279174 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: Openstack-Api-Version: compute 2.90 Aug 01 16:32:15.279174 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: Openstack-System-Scope: None Aug 01 16:32:15.279174 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: User-Agent: python-novaclient Aug 01 16:32:15.279174 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: X-Auth-Token: gAAAAABi6AAOJlDEbFUEnP2B0MqcGeK7Vr1Z6JeFg7U92G8oy5YYS2IpWoGCirzIhwJCVkHshA4Op2h0Wdg0OtWyxyCG8pZanLRcJPaoyjhVdkUpRDgNN_sVZzTUNkBL9OewWrFEKS3SLfp_aRib5qKfwgNCjIaiFMV_bA4WiYp43dGbnWubSnw Aug 01 16:32:15.279174 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: X-Domain-Id: None Aug 01 16:32:15.279174 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: X-Domain-Name: None Aug 01 16:32:15.279174 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: X-Identity-Status: Confirmed Aug 01 16:32:15.279174 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: X-Is-Admin-Project: True Aug 01 16:32:15.279174 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: X-Openstack-Nova-Api-Version: 2.90 Aug 01 16:32:15.279174 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: X-Project-Domain-Id: default Aug 01 16:32:15.279174 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: X-Project-Domain-Name: Default Aug 01 16:32:15.279174 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: X-Project-Id: 0c8a8aa32f9a4584972956058f337380 Aug 01 16:32:15.279174 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: X-Project-Name: admin Aug 01 16:32:15.279174 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: X-Role: reader,member,admin Aug 01 16:32:15.279174 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: X-Roles: reader,member,admin Aug 01 16:32:15.280751 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_0c8a8aa32f9a4584972956058f337380"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/0c8a8aa32f9a4584972956058f337380"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0c8a8aa32f9a4584972956058f337380"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0c8a8aa32f9a4584972956058f337380"}]}] Aug 01 16:32:15.280751 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: X-Tenant: admin Aug 01 16:32:15.280751 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: X-Tenant-Id: 0c8a8aa32f9a4584972956058f337380 Aug 01 16:32:15.280751 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: X-Tenant-Name: admin Aug 01 16:32:15.280751 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: X-User: admin Aug 01 16:32:15.280751 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: X-User-Domain-Id: default Aug 01 16:32:15.280751 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: X-User-Domain-Name: Default Aug 01 16:32:15.280751 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: X-User-Id: cc7787b19b7142fdb85a77e20df6ff3d Aug 01 16:32:15.280751 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: X-User-Name: admin Aug 01 16:32:15.280751 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: method: > Aug 01 16:32:15.280751 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: exception: Flavor 451 could not be found. Aug 01 16:32:15.280751 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: action_args: {'id': '451'} Aug 01 16:32:15.280751 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: {{(pid=103592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:32:15.280751 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:32:15.281678 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 01 16:32:15.281678 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 01 16:32:15.281678 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 01 16:32:15.281678 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 01 16:32:15.281678 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 16:32:15.281678 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 16:32:15.281678 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 01 16:32:15.281678 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 01 16:32:15.281678 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 01 16:32:15.281678 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:32:15.281678 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 01 16:32:15.281678 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 01 16:32:15.281678 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 01 16:32:15.281678 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi Aug 01 16:32:15.281678 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:32:15.281678 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi Aug 01 16:32:15.281678 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:32:15.281678 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:32:15.281678 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:32:15.282942 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:32:15.282942 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:32:15.282942 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:32:15.282942 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:32:15.282942 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 01 16:32:15.282942 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:32:15.282942 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 01 16:32:15.282942 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi Aug 01 16:32:15.282942 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:32:15.282942 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi Aug 01 16:32:15.282942 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:32:15.282942 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:32:15.282942 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:32:15.282942 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:32:15.282942 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:32:15.282942 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 01 16:32:15.282942 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: ERROR nova.api.openstack.wsgi Aug 01 16:32:15.282942 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi [None req-68cfd851-3205-4d06-a0d4-b84c5a739f0d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103592) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:32:15.284017 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: INFO nova.api.openstack.requestlog [None req-68cfd851-3205-4d06-a0d4-b84c5a739f0d admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.445173 Aug 01 16:32:15.284017 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: [pid: 103592|app: 0|req: 25/49] 10.222.0.45 () {60 vars in 1193 bytes} [Mon Aug 1 16:32:14 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 446 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 01 16:32:15.290580 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi [None req-8621ffd6-e40a-4359-b1e6-d3c6886d44c1 admin admin] Calling method '>' {{(pid=103593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:32:15.308691 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: INFO nova.api.openstack.requestlog [None req-8621ffd6-e40a-4359-b1e6-d3c6886d44c1 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021540 Aug 01 16:32:15.309272 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: [pid: 103593|app: 0|req: 25/50] 10.222.0.45 () {60 vars in 1210 bytes} [Mon Aug 1 16:32:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:32:15.319270 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi [None req-e75aefb2-131c-4e91-a8da-115f802f2498 admin admin] Calling method '>' {{(pid=103592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:32:15.334815 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: INFO nova.api.openstack.requestlog [None req-e75aefb2-131c-4e91-a8da-115f802f2498 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019059 Aug 01 16:32:15.335380 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: [pid: 103592|app: 0|req: 26/51] 10.222.0.45 () {60 vars in 1210 bytes} [Mon Aug 1 16:32:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:32:15.345423 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi [None req-58a1463f-ce03-477e-852e-d148ce53dc0b admin admin] Calling method '>' {{(pid=103593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:32:15.351075 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: INFO nova.api.openstack.wsgi [None req-58a1463f-ce03-477e-852e-d148ce53dc0b admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 01 16:32:15.352641 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi [None req-58a1463f-ce03-477e-852e-d148ce53dc0b admin admin] Request method failure captured: Aug 01 16:32:15.352641 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 01 16:32:15.352641 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: Accept: application/json Aug 01 16:32:15.352641 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: Accept-Encoding: gzip, deflate Aug 01 16:32:15.352641 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: Connection: keep-alive Aug 01 16:32:15.352641 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: Content-Length: 0 Aug 01 16:32:15.352641 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: Host: 10.222.0.45 Aug 01 16:32:15.352641 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: Openstack-Api-Version: compute 2.90 Aug 01 16:32:15.352641 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: Openstack-System-Scope: None Aug 01 16:32:15.352641 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: User-Agent: python-novaclient Aug 01 16:32:15.352641 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: X-Auth-Token: gAAAAABi6AAOJlDEbFUEnP2B0MqcGeK7Vr1Z6JeFg7U92G8oy5YYS2IpWoGCirzIhwJCVkHshA4Op2h0Wdg0OtWyxyCG8pZanLRcJPaoyjhVdkUpRDgNN_sVZzTUNkBL9OewWrFEKS3SLfp_aRib5qKfwgNCjIaiFMV_bA4WiYp43dGbnWubSnw Aug 01 16:32:15.352641 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: X-Domain-Id: None Aug 01 16:32:15.352641 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: X-Domain-Name: None Aug 01 16:32:15.352641 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: X-Identity-Status: Confirmed Aug 01 16:32:15.352641 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: X-Is-Admin-Project: True Aug 01 16:32:15.352641 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: X-Openstack-Nova-Api-Version: 2.90 Aug 01 16:32:15.352641 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: X-Project-Domain-Id: default Aug 01 16:32:15.352641 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: X-Project-Domain-Name: Default Aug 01 16:32:15.352641 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: X-Project-Id: 0c8a8aa32f9a4584972956058f337380 Aug 01 16:32:15.352641 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: X-Project-Name: admin Aug 01 16:32:15.352641 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: X-Role: reader,member,admin Aug 01 16:32:15.352641 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: X-Roles: reader,member,admin Aug 01 16:32:15.354397 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_0c8a8aa32f9a4584972956058f337380"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/0c8a8aa32f9a4584972956058f337380"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0c8a8aa32f9a4584972956058f337380"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0c8a8aa32f9a4584972956058f337380"}]}] Aug 01 16:32:15.354397 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: X-Tenant: admin Aug 01 16:32:15.354397 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: X-Tenant-Id: 0c8a8aa32f9a4584972956058f337380 Aug 01 16:32:15.354397 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: X-Tenant-Name: admin Aug 01 16:32:15.354397 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: X-User: admin Aug 01 16:32:15.354397 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: X-User-Domain-Id: default Aug 01 16:32:15.354397 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: X-User-Domain-Name: Default Aug 01 16:32:15.354397 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: X-User-Id: cc7787b19b7142fdb85a77e20df6ff3d Aug 01 16:32:15.354397 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: X-User-Name: admin Aug 01 16:32:15.354397 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: method: > Aug 01 16:32:15.354397 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: exception: Flavor 451 could not be found. Aug 01 16:32:15.354397 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: action_args: {'id': '451'} Aug 01 16:32:15.354397 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: {{(pid=103593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:32:15.354397 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:32:15.355429 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 01 16:32:15.355429 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 01 16:32:15.355429 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 01 16:32:15.355429 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 01 16:32:15.355429 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 16:32:15.355429 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 16:32:15.355429 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 01 16:32:15.355429 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 01 16:32:15.355429 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 01 16:32:15.355429 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:32:15.355429 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 01 16:32:15.355429 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 01 16:32:15.355429 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 01 16:32:15.355429 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi Aug 01 16:32:15.355429 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:32:15.355429 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi Aug 01 16:32:15.355429 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:32:15.355429 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:32:15.355429 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:32:15.356572 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:32:15.356572 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:32:15.356572 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:32:15.356572 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:32:15.356572 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 01 16:32:15.356572 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:32:15.356572 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 01 16:32:15.356572 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi Aug 01 16:32:15.356572 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:32:15.356572 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi Aug 01 16:32:15.356572 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:32:15.356572 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:32:15.356572 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:32:15.356572 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:32:15.356572 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:32:15.356572 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 01 16:32:15.356572 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: ERROR nova.api.openstack.wsgi Aug 01 16:32:15.356572 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi [None req-58a1463f-ce03-477e-852e-d148ce53dc0b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:32:15.357631 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: INFO nova.api.openstack.requestlog [None req-58a1463f-ce03-477e-852e-d148ce53dc0b admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012424 Aug 01 16:32:15.357631 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: [pid: 103593|app: 0|req: 26/52] 10.222.0.45 () {60 vars in 1193 bytes} [Mon Aug 1 16:32:15 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 01 16:32:16.359723 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi [None req-e75aefb2-131c-4e91-a8da-115f802f2498 admin admin] Calling method '>' {{(pid=103592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:32:16.360820 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: INFO nova.api.openstack.requestlog [None req-e75aefb2-131c-4e91-a8da-115f802f2498 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001658 Aug 01 16:32:16.361213 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: [pid: 103592|app: 0|req: 27/53] 10.222.0.45 () {56 vars in 1074 bytes} [Mon Aug 1 16:32:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:32:16.926881 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi [None req-c86b40f5-0ffd-4da0-a464-6378cb0b60cf admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:32:16.949920 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: INFO nova.api.openstack.requestlog [None req-c86b40f5-0ffd-4da0-a464-6378cb0b60cf admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.447311 Aug 01 16:32:16.950471 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: [pid: 103593|app: 0|req: 27/54] 10.222.0.45 () {64 vars in 1235 bytes} [Mon Aug 1 16:32:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 16:32:17.939366 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi [None req-e75aefb2-131c-4e91-a8da-115f802f2498 admin admin] Calling method '>' {{(pid=103592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:32:17.940428 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: INFO nova.api.openstack.requestlog [None req-e75aefb2-131c-4e91-a8da-115f802f2498 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Aug 01 16:32:17.940830 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: [pid: 103592|app: 0|req: 28/55] 10.222.0.45 () {56 vars in 1074 bytes} [Mon Aug 1 16:32:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:32:18.628531 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi [None req-3bcd4263-3307-46c6-a94f-720090f86200 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:32:18.649569 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: INFO nova.api.openstack.requestlog [None req-3bcd4263-3307-46c6-a94f-720090f86200 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.571011 Aug 01 16:32:18.650111 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: [pid: 103593|app: 0|req: 28/56] 10.222.0.45 () {64 vars in 1235 bytes} [Mon Aug 1 16:32:18 2022] POST /compute/v2.1/flavors => generated 405 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 16:32:19.622002 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi [None req-e75aefb2-131c-4e91-a8da-115f802f2498 admin admin] Calling method '>' {{(pid=103592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:32:19.623016 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: INFO nova.api.openstack.requestlog [None req-e75aefb2-131c-4e91-a8da-115f802f2498 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Aug 01 16:32:19.623416 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: [pid: 103592|app: 0|req: 29/57] 10.222.0.45 () {56 vars in 1074 bytes} [Mon Aug 1 16:32:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:32:20.185725 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi [None req-a9f53540-d61f-4e8e-b268-346ac3407e23 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:32:20.206701 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: INFO nova.api.openstack.requestlog [None req-a9f53540-d61f-4e8e-b268-346ac3407e23 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.445169 Aug 01 16:32:20.207249 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: [pid: 103593|app: 0|req: 29/58] 10.222.0.45 () {64 vars in 1235 bytes} [Mon Aug 1 16:32:19 2022] POST /compute/v2.1/flavors => generated 407 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 16:32:21.323975 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi [None req-e75aefb2-131c-4e91-a8da-115f802f2498 admin admin] Calling method '>' {{(pid=103592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:32:21.325079 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: INFO nova.api.openstack.requestlog [None req-e75aefb2-131c-4e91-a8da-115f802f2498 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001652 Aug 01 16:32:21.325530 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: [pid: 103592|app: 0|req: 30/59] 10.222.0.45 () {56 vars in 1074 bytes} [Mon Aug 1 16:32:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:32:21.871960 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi [None req-34e0ecb1-160b-402d-9506-ac8b4d895211 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:32:21.893012 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: INFO nova.api.openstack.requestlog [None req-34e0ecb1-160b-402d-9506-ac8b4d895211 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.426148 Aug 01 16:32:21.893477 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: [pid: 103593|app: 0|req: 30/60] 10.222.0.45 () {64 vars in 1235 bytes} [Mon Aug 1 16:32:21 2022] POST /compute/v2.1/flavors => generated 409 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 16:32:22.877723 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi [None req-e75aefb2-131c-4e91-a8da-115f802f2498 admin admin] Calling method '>' {{(pid=103592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:32:22.878777 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: INFO nova.api.openstack.requestlog [None req-e75aefb2-131c-4e91-a8da-115f802f2498 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Aug 01 16:32:22.879182 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: [pid: 103592|app: 0|req: 31/61] 10.222.0.45 () {56 vars in 1074 bytes} [Mon Aug 1 16:32:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:32:23.430085 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi [None req-fe173afd-ae87-4f49-b7b4-c37c18523834 admin admin] Calling method '>' {{(pid=103593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:32:23.451205 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: INFO nova.api.openstack.requestlog [None req-fe173afd-ae87-4f49-b7b4-c37c18523834 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.431314 Aug 01 16:32:23.451661 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: [pid: 103593|app: 0|req: 31/62] 10.222.0.45 () {60 vars in 1202 bytes} [Mon Aug 1 16:32:23 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:33:15.875639 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi [None req-e75aefb2-131c-4e91-a8da-115f802f2498 admin admin] Calling method '>' {{(pid=103592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:33:15.876805 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: INFO nova.api.openstack.requestlog [None req-e75aefb2-131c-4e91-a8da-115f802f2498 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001618 Aug 01 16:33:15.877207 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: [pid: 103592|app: 0|req: 32/63] 10.222.0.45 () {54 vars in 930 bytes} [Mon Aug 1 16:33:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:33:15.888135 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG dbcounter [-] [103593] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:33:16.296441 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi [None req-6a47a97f-e3b4-4494-b3f1-14b57545fb63 admin admin] Calling method '>' {{(pid=103593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:33:16.318972 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: INFO nova.api.openstack.requestlog [None req-6a47a97f-e3b4-4494-b3f1-14b57545fb63 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.435097 Aug 01 16:33:16.320030 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: [pid: 103593|app: 0|req: 32/64] 10.222.0.45 () {60 vars in 1291 bytes} [Mon Aug 1 16:33:15 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:33:16.349726 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG dbcounter [-] [103592] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:33:16.353713 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi [None req-55f3d4fb-eb02-44a2-8a1b-3587420dc745 admin admin] Calling method '>' {{(pid=103592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:33:16.362132 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: INFO nova.api.openstack.requestlog [None req-55f3d4fb-eb02-44a2-8a1b-3587420dc745 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013922 Aug 01 16:33:16.363034 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: [pid: 103592|app: 0|req: 33/65] 10.222.0.45 () {60 vars in 1282 bytes} [Mon Aug 1 16:33:16 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:33:16.375376 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi [None req-47098a91-d5f8-4465-9243-8828f6f7f414 admin admin] Calling method '>' {{(pid=103593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:33:16.383381 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: INFO nova.api.openstack.requestlog [None req-47098a91-d5f8-4465-9243-8828f6f7f414 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011774 Aug 01 16:33:16.383942 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: [pid: 103593|app: 0|req: 33/66] 10.222.0.45 () {60 vars in 1285 bytes} [Mon Aug 1 16:33:16 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:33:16.396604 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi [None req-a779360d-0e89-4521-bfb2-0509f1eb0704 admin admin] Calling method '>' {{(pid=103592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:33:16.405245 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: INFO nova.api.openstack.requestlog [None req-a779360d-0e89-4521-bfb2-0509f1eb0704 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012610 Aug 01 16:33:16.405822 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: [pid: 103592|app: 0|req: 34/67] 10.222.0.45 () {60 vars in 1285 bytes} [Mon Aug 1 16:33:16 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:33:16.421391 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi [None req-74046c3f-1848-4cb8-a330-6301560d7473 admin admin] Calling method '>' {{(pid=103593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:33:16.434329 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: INFO nova.api.openstack.requestlog [None req-74046c3f-1848-4cb8-a330-6301560d7473 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.019532 Aug 01 16:33:16.434925 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: [pid: 103593|app: 0|req: 34/68] 10.222.0.45 () {60 vars in 1282 bytes} [Mon Aug 1 16:33:16 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:36:51.297809 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi [None req-a779360d-0e89-4521-bfb2-0509f1eb0704 admin admin] Calling method '>' {{(pid=103592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:36:51.301653 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: INFO nova.api.openstack.requestlog [None req-a779360d-0e89-4521-bfb2-0509f1eb0704 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.004709 Aug 01 16:36:51.302111 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: [pid: 103592|app: 0|req: 35/69] 10.222.0.45 () {56 vars in 1074 bytes} [Mon Aug 1 16:36:51 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:36:51.444536 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG dbcounter [-] [103593] Writing DB stats nova_api:SELECT=6 {{(pid=103593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:36:51.622159 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi [None req-6d6807a7-96d0-41c9-9416-760516602be4 admin admin] Calling method '>' {{(pid=103593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:36:51.626425 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 16:36:51.626425 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: warnings.warn(msg) Aug 01 16:36:51.628627 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG oslo_concurrency.lockutils [None req-6d6807a7-96d0-41c9-9416-760516602be4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:36:51.629681 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG oslo_concurrency.lockutils [None req-6d6807a7-96d0-41c9-9416-760516602be4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:36:51.631021 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG oslo_concurrency.lockutils [None req-6d6807a7-96d0-41c9-9416-760516602be4 admin admin] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:36:51.631797 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG oslo_concurrency.lockutils [None req-6d6807a7-96d0-41c9-9416-760516602be4 admin admin] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:36:51.697663 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: INFO nova.api.openstack.requestlog [None req-6d6807a7-96d0-41c9-9416-760516602be4 admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.254101 Aug 01 16:36:51.698691 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: [pid: 103593|app: 0|req: 35/70] 10.222.0.45 () {60 vars in 1193 bytes} [Mon Aug 1 16:36:51 2022] GET /compute/v2.1/os-services => generated 791 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 16:36:52.580469 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi [None req-a779360d-0e89-4521-bfb2-0509f1eb0704 admin admin] Calling method '>' {{(pid=103592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:36:52.581530 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: INFO nova.api.openstack.requestlog [None req-a779360d-0e89-4521-bfb2-0509f1eb0704 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 Aug 01 16:36:52.581979 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: [pid: 103592|app: 0|req: 36/71] 10.222.0.45 () {56 vars in 1074 bytes} [Mon Aug 1 16:36:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:36:52.781359 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi [None req-a5ae7f2b-c698-40bb-9530-f0ed52e10a3c admin admin] Calling method '>' {{(pid=103593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:36:52.783808 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 16:36:52.783808 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: warnings.warn(msg) Aug 01 16:36:52.785015 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG oslo_concurrency.lockutils [None req-a5ae7f2b-c698-40bb-9530-f0ed52e10a3c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:36:52.785456 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG oslo_concurrency.lockutils [None req-a5ae7f2b-c698-40bb-9530-f0ed52e10a3c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:36:52.786247 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG oslo_concurrency.lockutils [None req-a5ae7f2b-c698-40bb-9530-f0ed52e10a3c admin admin] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:36:52.786677 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG oslo_concurrency.lockutils [None req-a5ae7f2b-c698-40bb-9530-f0ed52e10a3c admin admin] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:36:52.807939 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: INFO nova.api.openstack.requestlog [None req-a5ae7f2b-c698-40bb-9530-f0ed52e10a3c admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.085284 Aug 01 16:36:52.808567 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: [pid: 103593|app: 0|req: 36/72] 10.222.0.45 () {60 vars in 1193 bytes} [Mon Aug 1 16:36:52 2022] GET /compute/v2.1/os-services => generated 791 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 16:37:04.091232 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi [None req-a779360d-0e89-4521-bfb2-0509f1eb0704 admin admin] Calling method '>' {{(pid=103592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:37:04.092274 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: INFO nova.api.openstack.requestlog [None req-a779360d-0e89-4521-bfb2-0509f1eb0704 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Aug 01 16:37:04.092723 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: [pid: 103592|app: 0|req: 37/73] 10.222.0.45 () {56 vars in 1074 bytes} [Mon Aug 1 16:37:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:37:04.240241 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG dbcounter [-] [103593] Writing DB stats nova_cell0:SELECT=4 {{(pid=103593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:37:04.240981 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG dbcounter [-] [103593] Writing DB stats nova_cell1:SELECT=4 {{(pid=103593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:37:04.241649 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG dbcounter [-] [103593] Writing DB stats nova_api:SELECT=8 {{(pid=103593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:37:04.292676 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi [None req-2b9d01c1-05b5-4d48-b86f-4ae7add33111 admin admin] Calling method '>' {{(pid=103593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:37:04.295064 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 16:37:04.295064 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: warnings.warn(msg) Aug 01 16:37:04.296354 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG oslo_concurrency.lockutils [None req-2b9d01c1-05b5-4d48-b86f-4ae7add33111 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:37:04.296726 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG oslo_concurrency.lockutils [None req-2b9d01c1-05b5-4d48-b86f-4ae7add33111 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:37:04.297507 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG oslo_concurrency.lockutils [None req-2b9d01c1-05b5-4d48-b86f-4ae7add33111 admin admin] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:37:04.297934 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG oslo_concurrency.lockutils [None req-2b9d01c1-05b5-4d48-b86f-4ae7add33111 admin admin] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:37:04.331213 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: INFO nova.api.openstack.requestlog [None req-2b9d01c1-05b5-4d48-b86f-4ae7add33111 admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.095351 Aug 01 16:37:04.331792 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: [pid: 103593|app: 0|req: 37/74] 10.222.0.45 () {60 vars in 1193 bytes} [Mon Aug 1 16:37:04 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:37:05.169333 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: DEBUG nova.api.openstack.wsgi [None req-a779360d-0e89-4521-bfb2-0509f1eb0704 admin admin] Calling method '>' {{(pid=103592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:37:05.170356 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: INFO nova.api.openstack.requestlog [None req-a779360d-0e89-4521-bfb2-0509f1eb0704 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Aug 01 16:37:05.170758 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: [pid: 103592|app: 0|req: 38/75] 10.222.0.45 () {56 vars in 1074 bytes} [Mon Aug 1 16:37:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:37:05.370783 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG nova.api.openstack.wsgi [None req-682310a0-2329-4e15-bdd1-e070d74da1eb admin admin] Calling method '>' {{(pid=103593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:37:05.373303 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 16:37:05.373303 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: warnings.warn(msg) Aug 01 16:37:05.374421 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG oslo_concurrency.lockutils [None req-682310a0-2329-4e15-bdd1-e070d74da1eb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:37:05.374860 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG oslo_concurrency.lockutils [None req-682310a0-2329-4e15-bdd1-e070d74da1eb admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:37:05.375637 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG oslo_concurrency.lockutils [None req-682310a0-2329-4e15-bdd1-e070d74da1eb admin admin] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:37:05.376082 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: DEBUG oslo_concurrency.lockutils [None req-682310a0-2329-4e15-bdd1-e070d74da1eb admin admin] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:37:05.397712 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: INFO nova.api.openstack.requestlog [None req-682310a0-2329-4e15-bdd1-e070d74da1eb admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.085244 Aug 01 16:37:05.398339 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: [pid: 103593|app: 0|req: 38/76] 10.222.0.45 () {60 vars in 1193 bytes} [Mon Aug 1 16:37:05 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:38:01.865956 dv-cinder-850321-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 01 16:38:01.866576 dv-cinder-850321-2-iscsi devstack@n-api.service[103591]: Mon Aug 1 16:38:01 2022 - graceful shutdown triggered... Aug 01 16:38:01.867024 dv-cinder-850321-2-iscsi devstack@n-api.service[103592]: Gracefully killing worker 1 (pid: 103592)... Aug 01 16:38:01.868176 dv-cinder-850321-2-iscsi devstack@n-api.service[103593]: Gracefully killing worker 2 (pid: 103593)... Aug 01 16:38:02.867831 dv-cinder-850321-2-iscsi devstack@n-api.service[103591]: worker 1 buried after 1 seconds Aug 01 16:38:02.867831 dv-cinder-850321-2-iscsi devstack@n-api.service[103591]: worker 2 buried after 1 seconds Aug 01 16:38:02.867831 dv-cinder-850321-2-iscsi devstack@n-api.service[103591]: goodbye to uWSGI. Aug 01 16:38:02.869633 dv-cinder-850321-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 01 16:38:02.870198 dv-cinder-850321-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 01 16:38:02.873122 dv-cinder-850321-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 01 16:38:02.883506 dv-cinder-850321-2-iscsi devstack@n-api.service[118101]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 01 16:38:02.886513 dv-cinder-850321-2-iscsi devstack@n-api.service[118101]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 1 16:38:02 2022] *** Aug 01 16:38:02.886513 dv-cinder-850321-2-iscsi devstack@n-api.service[118101]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 01 16:38:02.886513 dv-cinder-850321-2-iscsi devstack@n-api.service[118101]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 01 16:38:02.886513 dv-cinder-850321-2-iscsi devstack@n-api.service[118101]: nodename: dv-cinder-850321-2-iscsi Aug 01 16:38:02.886513 dv-cinder-850321-2-iscsi devstack@n-api.service[118101]: machine: x86_64 Aug 01 16:38:02.886513 dv-cinder-850321-2-iscsi devstack@n-api.service[118101]: clock source: unix Aug 01 16:38:02.886513 dv-cinder-850321-2-iscsi devstack@n-api.service[118101]: pcre jit disabled Aug 01 16:38:02.886513 dv-cinder-850321-2-iscsi devstack@n-api.service[118101]: detected number of CPU cores: 4 Aug 01 16:38:02.886513 dv-cinder-850321-2-iscsi devstack@n-api.service[118101]: current working directory: / Aug 01 16:38:02.886513 dv-cinder-850321-2-iscsi devstack@n-api.service[118101]: detected binary path: /usr/bin/uwsgi-core Aug 01 16:38:02.886513 dv-cinder-850321-2-iscsi devstack@n-api.service[118101]: your processes number limit is 47680 Aug 01 16:38:02.886513 dv-cinder-850321-2-iscsi devstack@n-api.service[118101]: your memory page size is 4096 bytes Aug 01 16:38:02.886513 dv-cinder-850321-2-iscsi devstack@n-api.service[118101]: detected max file descriptor number: 2048 Aug 01 16:38:02.886513 dv-cinder-850321-2-iscsi devstack@n-api.service[118101]: lock engine: pthread robust mutexes Aug 01 16:38:02.887739 dv-cinder-850321-2-iscsi devstack@n-api.service[118101]: thunder lock: enabled Aug 01 16:38:02.887739 dv-cinder-850321-2-iscsi devstack@n-api.service[118101]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 01 16:38:02.887739 dv-cinder-850321-2-iscsi devstack@n-api.service[118101]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 01 16:38:02.931361 dv-cinder-850321-2-iscsi devstack@n-api.service[118101]: Python main interpreter initialized at 0x560e474959c0 Aug 01 16:38:02.931361 dv-cinder-850321-2-iscsi devstack@n-api.service[118101]: python threads support enabled Aug 01 16:38:02.931361 dv-cinder-850321-2-iscsi devstack@n-api.service[118101]: your server socket listen backlog is limited to 100 connections Aug 01 16:38:02.931361 dv-cinder-850321-2-iscsi devstack@n-api.service[118101]: your mercy for graceful operations on workers is 90 seconds Aug 01 16:38:02.931750 dv-cinder-850321-2-iscsi devstack@n-api.service[118101]: mapped 403077 bytes (393 KB) for 2 cores Aug 01 16:38:02.931750 dv-cinder-850321-2-iscsi devstack@n-api.service[118101]: *** Operational MODE: preforking *** Aug 01 16:38:02.932085 dv-cinder-850321-2-iscsi devstack@n-api.service[118101]: *** uWSGI is running in multiple interpreter mode *** Aug 01 16:38:02.932085 dv-cinder-850321-2-iscsi devstack@n-api.service[118101]: spawned uWSGI master process (pid: 118101) Aug 01 16:38:02.932304 dv-cinder-850321-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 01 16:38:02.933737 dv-cinder-850321-2-iscsi devstack@n-api.service[118101]: spawned uWSGI worker 1 (pid: 118117, cores: 1) Aug 01 16:38:02.933737 dv-cinder-850321-2-iscsi devstack@n-api.service[118101]: spawned uWSGI worker 2 (pid: 118118, cores: 1) Aug 01 16:38:02.933953 dv-cinder-850321-2-iscsi devstack@n-api.service[118101]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 01 16:38:03.603874 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 01 16:38:03.626333 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 01 16:38:04.801187 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 16:38:04.801187 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: from cryptography.utils import int_from_bytes Aug 01 16:38:04.801187 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 16:38:04.801187 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: from cryptography.utils import int_from_bytes Aug 01 16:38:04.907822 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 16:38:04.907822 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: from cryptography.utils import int_from_bytes Aug 01 16:38:04.908790 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 16:38:04.908790 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: from cryptography.utils import int_from_bytes Aug 01 16:38:07.291688 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 01 16:38:07.292617 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 01 16:38:07.292617 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 01 16:38:07.292964 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 01 16:38:07.293142 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 01 16:38:07.293513 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.293811 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.294140 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.294457 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.294791 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.295171 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.295499 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.295843 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.296175 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.296443 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.296759 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.297086 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850321-2-iscsi {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.297406 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.297882 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.298199 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.298524 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.298835 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.299160 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.299464 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.299998 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.300759 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.301071 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.301385 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.301727 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.302044 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.302355 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.302685 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.302996 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.303331 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.303632 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.304080 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850321-2-iscsi {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.304398 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.304713 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.305431 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.305614 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.305956 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.306267 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.306587 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.306909 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.307218 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.307557 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.307899 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.308225 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.308543 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.308843 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.309147 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.309457 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.309769 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.310080 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.310387 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.310637 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.310944 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.311262 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.311584 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.311933 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.312192 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.312444 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.312772 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.313092 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.313400 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.313707 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.314012 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.314318 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.314625 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.314930 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.315235 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.315537 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.315882 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.316209 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.316532 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.316838 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.317157 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.317564 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.317814 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.318121 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.318465 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.318780 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.319087 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.319408 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.319728 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.320068 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.320374 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.320781 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.321043 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.321381 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.321685 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.321936 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.322242 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.322547 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.322869 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.323173 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.323477 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.323838 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.324115 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.324412 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.324715 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.325026 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.325332 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.325635 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.325943 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.326248 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.326554 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.326858 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.327177 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.327492 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.327820 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.328130 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.328431 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.328741 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.329053 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.329353 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.329665 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.329986 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.330291 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.330594 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.330914 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.331218 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.331526 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.331866 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.332168 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.332536 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.332887 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.333099 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.333372 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.333677 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.333974 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.334279 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.334579 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.334878 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.335190 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.335484 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.335822 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.336143 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.336876 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.337191 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.337497 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.337819 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.338157 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.338494 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.338834 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.339147 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.339492 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.339863 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.340186 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.340500 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.340813 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.341139 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.341450 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.341760 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.342070 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.342379 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.342704 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.343038 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.343353 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.343669 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.344013 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.344320 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.344637 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.344967 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.345292 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.345601 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.345943 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.346289 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.346598 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.346922 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.347249 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.347557 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.347888 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.348199 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.348530 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.348853 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.349164 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.349480 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.349795 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.350098 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.350407 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.350722 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.351034 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.351375 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.351689 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.352072 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.352381 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.352707 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.353012 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.353321 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.353635 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.353934 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.354245 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.354546 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.354859 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.355161 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.355482 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.355836 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.356148 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.358443 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.358766 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.359091 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.359414 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.359736 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.360079 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.360558 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.360735 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.361006 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.361341 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.361656 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.361968 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.362318 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.362680 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.362920 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.363238 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.363552 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.363901 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.366146 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.366541 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.366902 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.367236 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.367602 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.367990 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.368343 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.368655 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.368988 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.369319 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.369644 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.369961 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.370281 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.370586 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.370893 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.371201 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.371514 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.371854 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.372168 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.372474 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.372784 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.373095 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.373415 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.373731 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.374039 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.374335 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.374638 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.374990 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.375287 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.375637 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.376007 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.376326 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.376653 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.377033 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.377287 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.377602 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.377910 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.378227 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.378543 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.378869 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.379170 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.379486 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.379818 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.380248 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.380561 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.380936 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.381242 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.381562 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.381906 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.382243 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.382560 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.382884 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.383206 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.383572 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.383851 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.384150 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.384662 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.384982 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.385409 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.385668 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.386931 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.387276 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.387641 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.388253 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.388545 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.388703 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.389034 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.389377 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.389714 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.390029 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.390346 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.390675 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.391100 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.391322 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.391646 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.391930 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.392448 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.392772 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.393163 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.394529 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.394529 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.394529 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.394529 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.395337 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.395337 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.395683 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.395889 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.396433 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.396596 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.396834 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.397186 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.397494 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.397763 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.398090 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.398401 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.398738 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.399067 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.399484 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.399861 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.400180 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.400487 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.400809 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.401135 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.401447 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.401768 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.402079 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.402390 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.402714 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.403030 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.403341 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.403652 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.403988 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.404311 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.404621 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.404944 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.405253 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.405564 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.405875 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.406292 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.406683 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.406849 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.407374 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.407726 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.408077 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.408389 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.408711 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.409021 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.409352 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.409679 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.410020 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.410337 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.410649 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.411181 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.411563 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.411903 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.412213 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.412672 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.412878 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.413167 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.413472 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.413778 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.414121 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.414414 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.414860 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.415899 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.415899 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.415899 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.416256 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.416489 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.416767 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.417024 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.417329 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.417740 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.417976 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.418324 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.418654 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.419001 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.419308 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.419610 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.420209 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.420506 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.420814 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.421119 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.421433 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.421743 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.422049 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.422362 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.422672 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.423009 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.423292 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.423598 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.423961 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.424239 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.424561 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.424872 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.425178 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.425482 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.425818 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.426131 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.426435 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.426717 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.427028 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.427348 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.427650 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.427993 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.428296 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.428607 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.428973 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.429278 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.429622 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.429917 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.430313 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.430591 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.430902 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.431208 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.431514 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.431907 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.431907 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.431907 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.431907 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.431907 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.431907 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.434645 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.434645 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.434645 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.435093 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.435252 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.435411 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.435737 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.436058 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.436389 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.436701 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.437016 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.437372 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.437630 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.437981 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.438288 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.438660 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.438989 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.439285 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.439605 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.439936 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.440259 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.440576 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.440908 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.441228 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.441513 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.441829 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.442132 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.442437 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.442765 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.443076 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.443387 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.443710 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.444066 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.444392 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.444700 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.445012 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.445322 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.445695 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.446202 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.446589 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.446912 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.447231 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.447588 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.447890 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.448208 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.448522 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.448835 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.449275 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.449451 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.449797 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.450107 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.450415 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.450726 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.451032 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.451369 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.451650 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.452143 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.452453 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.452770 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.453076 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.453390 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.453705 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.454024 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.454343 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.454649 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.455087 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.455410 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.455721 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.456065 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.456373 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.456677 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.456994 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.457325 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.457635 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.457940 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.458248 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.458574 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.458886 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.459212 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.459652 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.460000 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.460311 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.460735 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.461045 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.461539 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.461871 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.462199 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.462527 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.462837 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.463151 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.463468 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.463839 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.464188 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.464459 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.464775 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.465083 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.465408 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.465732 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.466049 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.466372 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.466820 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.467144 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.467545 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.467789 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.468134 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.468442 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.468745 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.469057 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.469369 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.469682 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.470016 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.470319 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.470633 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.470944 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.471256 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.471561 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.471898 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.472223 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.472529 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.472854 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.473173 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.473497 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.473819 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.474125 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.474448 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.474757 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.475063 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.475367 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.475671 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.476048 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.476360 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.476690 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.477057 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.477391 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.477704 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.478041 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.478373 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.478699 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.479015 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.479341 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.479651 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.479987 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.480298 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.480607 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.480911 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.481552 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.481872 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.482169 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.482478 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.482782 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.483114 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.483420 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.483740 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.484080 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.484384 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.484690 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.484991 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.485372 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.485629 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.485966 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.486291 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.486612 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.486949 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.487254 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.487584 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.487933 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.488250 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.488566 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.488893 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.489206 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.489523 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.489882 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.490148 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.490443 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.490756 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.491149 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.491668 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.492022 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.492342 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.493017 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.493336 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.493652 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.494061 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.494267 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.494592 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.494891 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.495202 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.495545 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.495900 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.496235 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.496580 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.496903 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.497228 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.497550 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.497867 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.498347 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.498666 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.499148 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.499338 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.499660 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.500085 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.500352 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.500769 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.501095 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.501533 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.501742 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.502026 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.502343 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.502659 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.502999 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.503341 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.503671 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.504010 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.504328 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.504649 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.505229 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.505547 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.505883 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.506214 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.506537 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.506866 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.507372 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.507553 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.507905 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.508561 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.509008 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.509227 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.509534 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.509793 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.510216 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.510470 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.510799 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.511117 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.511725 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.512122 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.512451 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.512787 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.513249 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.513577 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.513894 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.514228 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.514617 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.514926 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.515252 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.515573 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.515966 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.516283 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.516538 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.516855 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.517241 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.517600 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.517905 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.518380 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.518769 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.519133 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.519470 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.519678 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.520112 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.520498 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.520769 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.521120 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.521437 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.521783 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.522048 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.522402 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.522721 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.523033 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.523346 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.523744 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.524218 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.524534 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.524844 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.525174 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.525615 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.525941 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.526411 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.526658 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.526909 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.527241 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.527876 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.528222 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.528549 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.530159 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.530159 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.530159 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.530159 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.530159 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.531705 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.531705 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.531705 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.531705 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.531705 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.532892 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.532892 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.532892 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.532892 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.533751 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.533751 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.533751 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.534568 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.534568 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.535037 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.535037 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.535497 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.535719 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.536002 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.536241 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.536652 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.536904 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.537140 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.537461 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.537988 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.538233 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.538474 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.538728 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.538998 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.539462 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.540016 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.540439 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.540874 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.541129 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.541443 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.541965 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.542432 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.542692 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.543012 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.543351 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.543700 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.544061 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.544378 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.544690 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.545003 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.545399 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.545851 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.546125 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.546460 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.546702 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 01 16:38:07.547428 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.547581 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 01 16:38:07.547740 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.547913 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 01 16:38:07.548046 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.548046 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.548318 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 01 16:38:07.548318 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 01 16:38:07.548645 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.548645 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.548966 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.549268 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.549603 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.549933 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.550256 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.550594 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.550909 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.551372 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.551727 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.552031 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.552287 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.552566 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.552732 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.552891 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.553035 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.553248 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.553459 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.553629 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.553813 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.553983 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.554173 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850321-2-iscsi {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.554318 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.554492 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.554655 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.554840 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.555188 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.555432 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.555595 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.555738 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.556076 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.556228 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.556380 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.556580 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.556754 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.556967 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.557214 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.557397 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.557550 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.557550 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.557842 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.558004 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.558162 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.558314 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.558466 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.558466 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.558741 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.558897 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.559038 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.559179 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.559355 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.559574 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.559829 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.559829 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.560127 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.560327 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.560632 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.560782 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.561132 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.561481 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.561641 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.561793 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.561936 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850321-2-iscsi {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.562165 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.562361 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.562555 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.562793 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.562941 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.563091 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.563249 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.563400 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.563552 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.563701 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.563918 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.564090 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.564342 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.564495 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.564639 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.564806 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.565039 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.565268 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.565455 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.565636 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.565790 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.565932 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.566149 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.566351 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.566542 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.566699 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.566850 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.567002 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.567151 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.567303 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.567452 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.567602 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.567744 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.567909 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.568051 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.568268 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.568424 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.568585 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.568728 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.568869 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.569052 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.569275 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.569448 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.569601 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.569751 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.569902 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.570055 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.570208 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.570208 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.570511 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.570794 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.570954 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.571126 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.571382 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.571639 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.571826 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.571976 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.572210 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.572355 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.572504 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.572646 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.572823 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.573051 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.573211 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.573359 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.573507 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118117) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 01 16:38:07.573657 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.573657 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.573657 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.573657 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.573657 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.573657 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.573657 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.573657 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.574744 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.574744 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.574744 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.574744 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.575283 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.575283 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.575557 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.575748 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.576271 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.576576 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.576883 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.577201 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.577675 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.577828 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.578062 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.578359 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.579375 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.579375 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.579375 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.579891 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.579891 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.580162 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.580457 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.580719 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.581021 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.581752 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.581752 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.582498 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.582498 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.582498 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.584059 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.584059 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.584059 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.584059 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.584059 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.585122 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.585122 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.585122 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.585122 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.585720 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.585720 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.585720 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.585720 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.585720 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.593969 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.593969 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.593969 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.593969 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.593969 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.593969 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.593969 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.593969 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.595181 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.595181 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.595181 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.595181 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.595181 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.595181 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.595181 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.595181 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.596272 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.596272 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.596272 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.596272 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.596272 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 16:38:07.596272 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.596272 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.596272 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.597371 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.597371 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.597371 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.597371 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.597371 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.597371 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.597371 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.597371 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.598560 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.598560 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.598560 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.598560 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.598560 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.598560 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.599393 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.599393 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.599393 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.599845 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.599845 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.600304 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.600465 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.600768 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.601109 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.601418 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.601738 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.602089 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.602400 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.602705 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.603335 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.603335 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.603745 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.604025 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.604272 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.604614 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.604884 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.605190 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.605499 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.605807 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.606145 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.606805 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.607118 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.607426 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.607742 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.608228 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.608637 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.608844 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.609150 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.609455 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.609752 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.610057 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.610357 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.610676 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.611004 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.611309 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.611643 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.611973 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.612281 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.612589 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.612893 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.613220 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.613612 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.613787 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.614143 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.614405 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.614764 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.615011 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.615333 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.615637 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.615962 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.616281 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.616846 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.617012 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.617199 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.617558 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.623956 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.623956 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.623956 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.623956 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.623956 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.623956 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.623956 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.623956 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.625576 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.625576 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.625576 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.625576 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.625576 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.625576 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.625576 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.625576 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.626698 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.626698 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.626698 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.626698 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.626698 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.626698 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.626698 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.626698 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.627834 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.627834 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.627834 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.627834 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.627834 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.627834 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.627834 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.627834 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.628901 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.628901 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.628901 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.628901 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.629444 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.629650 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.629967 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.630285 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.630606 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.630915 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.631221 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.631539 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.631863 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.632180 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.632514 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.632843 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.638715 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO dbcounter [None req-4728dfd0-c5fb-4143-baf8-26e47a97ad06 None None] Registered counter for database nova_api Aug 01 16:38:07.639248 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.639248 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.639248 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.639248 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.639248 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.639248 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.639248 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.639248 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.640497 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.640497 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.640497 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.640497 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.640497 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.640497 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.640497 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.640497 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.641791 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.641791 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.641791 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.641791 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.641791 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.641791 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.641791 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.641791 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.642891 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.642891 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.642891 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.642891 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.642891 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.642891 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.642891 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.642891 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.644064 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.644064 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.644064 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.644064 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.644634 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.644634 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.644920 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.645327 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.645558 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.645857 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.646160 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.646476 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.646784 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.647084 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.647384 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.647681 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.649045 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.649045 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.649045 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.650548 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.650548 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.659549 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.659549 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.659549 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.659549 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.659549 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.659549 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.659549 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.659549 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.662066 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.662066 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.662066 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.662066 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.662066 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.662066 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.662066 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.662066 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.664250 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.664250 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.665723 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_db.sqlalchemy.engines [None req-4728dfd0-c5fb-4143-baf8-26e47a97ad06 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118117) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 16:38:07.665912 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.665912 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.665912 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.665912 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.665912 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.665912 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.665912 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.665912 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.667402 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.667402 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.667402 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.667402 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.667402 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.667402 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.667402 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.667402 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.668784 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.668784 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.668784 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.668784 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.668784 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.668784 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.668784 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.668784 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.674087 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.674087 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.674087 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.674087 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.674087 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.674087 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.674087 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.681216 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writer thread running {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 16:38:07.682001 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.682001 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.682001 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.682001 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.682001 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.682001 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.682001 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.682001 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.683202 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.683202 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.683202 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.683202 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.683202 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.683202 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.683202 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.683202 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.684969 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.684969 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.684969 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.684969 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.684969 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.684969 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.684969 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.684969 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.686122 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.686122 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.686122 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.686122 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.686122 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.686122 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.686122 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.686122 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.687290 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.687290 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.687290 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.687290 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.687290 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.687290 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.687290 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.687290 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.688443 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.688443 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.688443 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.688443 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.688443 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.688443 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.688443 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.688443 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.689731 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.689731 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.689731 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.689731 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.689731 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.689731 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.689731 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.689731 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.690883 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.690883 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.690883 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.690883 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.690883 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.691586 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.691795 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.692230 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.692922 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.693306 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.693615 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.693934 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.694261 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.694812 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.695049 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.695370 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.695906 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.696420 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.696746 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.697069 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.697379 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.697687 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.698019 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.698335 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.698649 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.698972 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.699297 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.700356 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.700668 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.700990 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.701509 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.701845 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.702080 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.702393 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.703037 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.703349 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.703668 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.704004 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.704318 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.704819 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.705020 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.705259 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.705561 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.705892 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.706203 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.706507 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.706817 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.707121 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.707432 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.707734 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.708202 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.708513 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.708823 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.709136 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.709438 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.709748 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.710064 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.710449 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.710676 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.711093 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.711482 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.711874 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.712135 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.712418 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.712865 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.713317 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.713645 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.713951 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.714256 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.714557 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.715058 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.715298 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.715477 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.715935 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.717020 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.717341 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.717768 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.718080 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.718385 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.718853 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.719391 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.719549 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.719827 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.720216 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.720498 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.720796 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.721057 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.721374 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.721682 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.721992 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.722311 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.722780 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.723349 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.724315 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.724315 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.724641 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.724789 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.725086 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.725424 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.725792 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.726083 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.726292 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.726599 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.726959 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.727286 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.727587 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.727873 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.context [None req-4728dfd0-c5fb-4143-baf8-26e47a97ad06 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e73af976-0ba6-4137-9c83-d8f1ddc84c77(cell1) {{(pid=118117) load_cells /opt/stack/nova/nova/context.py:464}} Aug 01 16:38:07.728055 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.728456 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.728604 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.728803 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.729107 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.729533 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.729841 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.730167 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.730467 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.730869 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.731108 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.731788 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.732099 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.732538 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.732700 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.732873 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-4728dfd0-c5fb-4143-baf8-26e47a97ad06 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:38:07.733164 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.734258 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.734258 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.734588 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.734744 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-4728dfd0-c5fb-4143-baf8-26e47a97ad06 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:38:07.734896 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.735072 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.735365 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-4728dfd0-c5fb-4143-baf8-26e47a97ad06 None None] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:38:07.735524 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.735679 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.736039 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.736430 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.736684 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.737004 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.737328 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.737486 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-4728dfd0-c5fb-4143-baf8-26e47a97ad06 None None] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:38:07.737639 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.737921 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.738231 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.738534 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.738839 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.739141 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.739446 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.739607 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO dbcounter [None req-4728dfd0-c5fb-4143-baf8-26e47a97ad06 None None] Registered counter for database nova_cell0 Aug 01 16:38:07.739780 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.740058 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.740359 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.740680 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.741018 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.741298 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.741603 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.741903 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.742572 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.742885 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.743523 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.743886 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.744084 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.744326 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO dbcounter [None req-4728dfd0-c5fb-4143-baf8-26e47a97ad06 None None] Registered counter for database nova_cell1 Aug 01 16:38:07.744482 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.744715 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.745050 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.745360 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.745680 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.745998 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.746312 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.746887 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.747523 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.748177 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.749929 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.753228 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.753228 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.753653 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_db.sqlalchemy.engines [None req-4728dfd0-c5fb-4143-baf8-26e47a97ad06 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118117) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 16:38:07.753824 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.753824 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.753824 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.754376 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_db.sqlalchemy.engines [None req-4728dfd0-c5fb-4143-baf8-26e47a97ad06 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118117) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 16:38:07.754521 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.754656 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.755378 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.755378 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.755748 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.756232 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.756584 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.756881 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.757187 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.757515 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.757805 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.759661 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.760160 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.760421 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.760961 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.761111 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.761448 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.761752 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.762075 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.762449 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.762773 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.763095 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.763415 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.763906 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.764229 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.764381 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writer thread running {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 16:38:07.764546 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.764859 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writer thread running {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 16:38:07.765015 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.765850 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.765850 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.765850 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.766489 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.766489 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.766942 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.767227 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.767361 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.767635 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.767978 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.768294 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.768609 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.769186 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.769513 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.769846 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.770177 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.770570 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.770819 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.771141 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.771476 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.771798 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.772110 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.772421 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.773475 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.773475 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.773475 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.774124 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.774332 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.774627 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.774995 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.775949 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.776118 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.776427 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.776730 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.777056 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.777454 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.777683 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.778004 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.778317 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.778622 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.778940 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.779259 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.779568 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.779887 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.780203 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.780514 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.780818 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.781142 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.781427 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.781757 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.782059 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.782368 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.782675 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.782992 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.783296 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.783594 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.784101 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.784474 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.784839 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.785186 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.785559 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.786152 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.786541 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.786963 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.787302 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.787710 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.788553 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.789004 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.789403 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.789763 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.790207 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.790578 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.790986 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.791351 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.791830 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.792251 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.792793 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.793147 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.793486 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.793846 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.794196 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.794519 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.794957 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.795279 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.795621 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.796263 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.796509 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.796740 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.797154 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.797424 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.797702 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.798071 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.798325 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.798648 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.798965 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.799285 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.799607 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.800127 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.800451 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.800782 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.801146 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.801545 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.801799 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.802111 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.802492 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.802715 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.803030 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.803347 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.803664 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.804014 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.804355 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.804741 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.805190 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.805834 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.806869 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.806869 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.807508 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.807508 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.807994 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.807994 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.808550 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.808698 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.808912 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.809255 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.809610 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.810102 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.810398 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.810718 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.811033 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.811476 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.812388 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.812388 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.812830 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.813762 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.813762 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.813762 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.814211 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.814914 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.815266 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.815739 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.816092 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.816405 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.817047 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.817267 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.817562 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.817788 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.818908 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.818908 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.819333 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.819551 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.819730 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.820075 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.820394 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.820805 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.821149 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.821479 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.821836 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.822126 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.822458 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.822904 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.823110 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.823501 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.823880 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.824204 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.824546 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.824864 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.825185 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.825493 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.825809 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.826745 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.827108 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.827537 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.827906 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.828226 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.828564 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.828892 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.829232 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.829569 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.829874 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.830215 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.830533 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.830851 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.831213 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.831538 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.831883 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.832208 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.832526 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.832844 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.833167 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.833490 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.833825 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.834158 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.834474 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.834808 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.835142 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.835500 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.835844 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.836253 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.836651 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.837272 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.837425 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.837699 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 16:38:07.837950 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118118) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 01 16:38:07.901674 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO dbcounter [None req-f2611c98-6fe4-4243-b636-db73676871ed None None] Registered counter for database nova_api Aug 01 16:38:07.922753 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_db.sqlalchemy.engines [None req-f2611c98-6fe4-4243-b636-db73676871ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118118) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 16:38:07.926517 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO dbcounter [None req-4728dfd0-c5fb-4143-baf8-26e47a97ad06 None None] Registered counter for database nova_cell0 Aug 01 16:38:07.931639 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writer thread running {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 16:38:07.940507 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_db.sqlalchemy.engines [None req-4728dfd0-c5fb-4143-baf8-26e47a97ad06 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118117) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 16:38:07.947258 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writer thread running {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 16:38:07.991119 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.context [None req-f2611c98-6fe4-4243-b636-db73676871ed None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e73af976-0ba6-4137-9c83-d8f1ddc84c77(cell1) {{(pid=118118) load_cells /opt/stack/nova/nova/context.py:464}} Aug 01 16:38:07.995446 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-f2611c98-6fe4-4243-b636-db73676871ed None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:38:07.997107 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-f2611c98-6fe4-4243-b636-db73676871ed None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:38:07.997866 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-f2611c98-6fe4-4243-b636-db73676871ed None None] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:38:08.000017 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-f2611c98-6fe4-4243-b636-db73676871ed None None] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:38:08.002091 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO dbcounter [None req-f2611c98-6fe4-4243-b636-db73676871ed None None] Registered counter for database nova_cell0 Aug 01 16:38:08.006652 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO dbcounter [None req-f2611c98-6fe4-4243-b636-db73676871ed None None] Registered counter for database nova_cell1 Aug 01 16:38:08.015002 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_db.sqlalchemy.engines [None req-f2611c98-6fe4-4243-b636-db73676871ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118118) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 16:38:08.017620 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_db.sqlalchemy.engines [None req-f2611c98-6fe4-4243-b636-db73676871ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118118) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 16:38:08.024790 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writer thread running {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 16:38:08.027019 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writer thread running {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 16:38:08.175234 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO dbcounter [None req-f2611c98-6fe4-4243-b636-db73676871ed None None] Registered counter for database nova_cell0 Aug 01 16:38:08.184579 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_db.sqlalchemy.engines [None req-f2611c98-6fe4-4243-b636-db73676871ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118118) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 16:38:08.189973 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writer thread running {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 16:38:08.284050 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: WARNING keystonemiddleware.auth_token [None req-4728dfd0-c5fb-4143-baf8-26e47a97ad06 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 16:38:08.294259 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: WARNING keystonemiddleware.auth_token [None req-4728dfd0-c5fb-4143-baf8-26e47a97ad06 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 16:38:08.508827 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: WARNING keystonemiddleware.auth_token [None req-f2611c98-6fe4-4243-b636-db73676871ed None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 16:38:08.517215 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: WARNING keystonemiddleware.auth_token [None req-f2611c98-6fe4-4243-b636-db73676871ed None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 16:38:08.655007 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: WARNING keystonemiddleware.auth_token [None req-4728dfd0-c5fb-4143-baf8-26e47a97ad06 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 16:38:08.661363 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: WARNING keystonemiddleware.auth_token [None req-4728dfd0-c5fb-4143-baf8-26e47a97ad06 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 16:38:08.667046 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560e474959c0 pid: 118117 (default app) Aug 01 16:38:08.871134 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: WARNING keystonemiddleware.auth_token [None req-f2611c98-6fe4-4243-b636-db73676871ed None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 16:38:08.877480 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: WARNING keystonemiddleware.auth_token [None req-f2611c98-6fe4-4243-b636-db73676871ed None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 16:38:08.883213 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560e474959c0 pid: 118118 (default app) Aug 01 16:38:57.165968 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_api:SELECT=3 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:57.167090 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_cell1:SELECT=3 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:57.168123 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_cell0:SELECT=3 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:57.171192 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_cell0:SELECT=3 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:58.800603 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-977d1800-a3af-4a3b-9496-08fc4f70e817 tempest-VolumesNegativeTest-442109307 tempest-VolumesNegativeTest-442109307-project] Action: 'create', calling method: .version_select at 0x7efd64c68ee0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1713749790", "metadata": {"Type": "work"}}} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:38:58.800603 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-977d1800-a3af-4a3b-9496-08fc4f70e817 tempest-VolumesNegativeTest-442109307 tempest-VolumesNegativeTest-442109307-project] Request method failure captured: Aug 01 16:38:58.800603 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 01 16:38:58.800603 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Accept: application/json Aug 01 16:38:58.800603 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Accept-Encoding: identity Aug 01 16:38:58.800603 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Connection: close Aug 01 16:38:58.800603 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Content-Length: 122 Aug 01 16:38:58.800603 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Content-Type: application/json Aug 01 16:38:58.800603 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Host: 10.222.0.45 Aug 01 16:38:58.800603 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Openstack-System-Scope: None Aug 01 16:38:58.800603 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: User-Agent: python-urllib3/1.26.10 Aug 01 16:38:58.800603 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Auth-Token: gAAAAABi6AGhuLhabQ3WR5ZNPEKJfnRsrRoaFZwVweZbJbXOaH95ZhaQUjXkFeqQe_t8ztf5HYeRZ2ZxZ_6X85h6R5l3tLnFhP9UiF8MCjPxghuo8QNZzEXl8VNqCr33upq7K-mZSXLhy-egiHUUG4rJBdA1vHsylzB8pUQ1PwKEJ1tOWLXPdEQ Aug 01 16:38:58.800603 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Domain-Id: None Aug 01 16:38:58.800603 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Domain-Name: None Aug 01 16:38:58.800603 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Identity-Status: Confirmed Aug 01 16:38:58.800603 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Is-Admin-Project: True Aug 01 16:38:58.800603 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Domain-Id: default Aug 01 16:38:58.800603 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Domain-Name: Default Aug 01 16:38:58.800603 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Id: 51b7e06f5b96485e8449852d67908bc1 Aug 01 16:38:58.800603 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Name: tempest-VolumesNegativeTest-442109307 Aug 01 16:38:58.800603 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Role: reader,member Aug 01 16:38:58.800603 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Roles: reader,member Aug 01 16:38:58.806880 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_51b7e06f5b96485e8449852d67908bc1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/51b7e06f5b96485e8449852d67908bc1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/51b7e06f5b96485e8449852d67908bc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/51b7e06f5b96485e8449852d67908bc1"}]}] Aug 01 16:38:58.806880 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Tenant: tempest-VolumesNegativeTest-442109307 Aug 01 16:38:58.806880 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Tenant-Id: 51b7e06f5b96485e8449852d67908bc1 Aug 01 16:38:58.806880 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Tenant-Name: tempest-VolumesNegativeTest-442109307 Aug 01 16:38:58.806880 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User: tempest-VolumesNegativeTest-442109307-project Aug 01 16:38:58.806880 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Domain-Id: default Aug 01 16:38:58.806880 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Domain-Name: Default Aug 01 16:38:58.806880 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Id: 7ebe8558580445f1806be8be7398e2c7 Aug 01 16:38:58.806880 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Name: tempest-VolumesNegativeTest-442109307-project Aug 01 16:38:58.806880 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Aug 01 16:38:58.806880 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1713749790", "metadata": {"Type": "work"}}} Aug 01 16:38:58.806880 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: method: Aug 01 16:38:58.806880 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 01 16:38:58.809409 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1713749790', 'metadata': {'Type': 'work'}}}} Aug 01 16:38:58.809409 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:38:58.809409 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:38:58.809409 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 01 16:38:58.809409 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 01 16:38:58.809409 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 01 16:38:58.809409 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi raise error Aug 01 16:38:58.809409 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 01 16:38:58.809409 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:38:58.809409 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 01 16:38:58.809409 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 01 16:38:58.809409 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:38:58.809409 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 01 16:38:58.809409 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi '#$%' Aug 01 16:38:58.809409 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:38:58.809409 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:38:58.809409 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:38:58.809409 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:38:58.809409 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:38:58.809409 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:38:58.809409 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:38:58.809409 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:38:58.815321 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 16:38:58.815321 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 16:38:58.815321 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:38:58.815321 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:38:58.815321 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 01 16:38:58.815321 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 01 16:38:58.815321 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 01 16:38:58.815321 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 01 16:38:58.815321 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 01 16:38:58.815321 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 01 16:38:58.815321 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 01 16:38:58.815321 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:38:58.815321 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:38:58.815321 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:38:58.815321 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:38:58.815321 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:38:58.815321 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:38:58.815321 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 01 16:38:58.815321 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 01 16:38:58.818799 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 01 16:38:58.818799 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:38:58.818799 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-977d1800-a3af-4a3b-9496-08fc4f70e817 tempest-VolumesNegativeTest-442109307 tempest-VolumesNegativeTest-442109307-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118117) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:38:58.818799 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-977d1800-a3af-4a3b-9496-08fc4f70e817 tempest-VolumesNegativeTest-442109307 tempest-VolumesNegativeTest-442109307-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.599996 Aug 01 16:38:58.818799 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 1/1] 10.222.0.45 () {60 vars in 1156 bytes} [Mon Aug 1 16:38:57 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1609 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 01 16:38:59.279258 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-df33be10-72a6-48b7-a27f-55e2130a2e09 tempest-VolumesNegativeTest-442109307 tempest-VolumesNegativeTest-442109307-project] Action: 'create', calling method: .version_select at 0x7efd64d459d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2111882478", "metadata": {"Type": "work"}}} {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:38:59.299058 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-df33be10-72a6-48b7-a27f-55e2130a2e09 tempest-VolumesNegativeTest-442109307 tempest-VolumesNegativeTest-442109307-project] Request method failure captured: Aug 01 16:38:59.299058 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 01 16:38:59.299058 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Accept: application/json Aug 01 16:38:59.299058 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Accept-Encoding: identity Aug 01 16:38:59.299058 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Connection: close Aug 01 16:38:59.299058 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Content-Length: 120 Aug 01 16:38:59.299058 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Content-Type: application/json Aug 01 16:38:59.299058 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Host: 10.222.0.45 Aug 01 16:38:59.299058 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Openstack-System-Scope: None Aug 01 16:38:59.299058 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: User-Agent: python-urllib3/1.26.10 Aug 01 16:38:59.299058 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Auth-Token: gAAAAABi6AGhuLhabQ3WR5ZNPEKJfnRsrRoaFZwVweZbJbXOaH95ZhaQUjXkFeqQe_t8ztf5HYeRZ2ZxZ_6X85h6R5l3tLnFhP9UiF8MCjPxghuo8QNZzEXl8VNqCr33upq7K-mZSXLhy-egiHUUG4rJBdA1vHsylzB8pUQ1PwKEJ1tOWLXPdEQ Aug 01 16:38:59.299058 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Domain-Id: None Aug 01 16:38:59.299058 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Domain-Name: None Aug 01 16:38:59.299058 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Identity-Status: Confirmed Aug 01 16:38:59.299058 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Is-Admin-Project: True Aug 01 16:38:59.299058 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Domain-Id: default Aug 01 16:38:59.299058 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Domain-Name: Default Aug 01 16:38:59.299058 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Id: 51b7e06f5b96485e8449852d67908bc1 Aug 01 16:38:59.299058 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Name: tempest-VolumesNegativeTest-442109307 Aug 01 16:38:59.299058 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Role: reader,member Aug 01 16:38:59.299058 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Roles: reader,member Aug 01 16:38:59.301128 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_51b7e06f5b96485e8449852d67908bc1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/51b7e06f5b96485e8449852d67908bc1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/51b7e06f5b96485e8449852d67908bc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/51b7e06f5b96485e8449852d67908bc1"}]}] Aug 01 16:38:59.301128 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant: tempest-VolumesNegativeTest-442109307 Aug 01 16:38:59.301128 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant-Id: 51b7e06f5b96485e8449852d67908bc1 Aug 01 16:38:59.301128 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant-Name: tempest-VolumesNegativeTest-442109307 Aug 01 16:38:59.301128 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User: tempest-VolumesNegativeTest-442109307-project Aug 01 16:38:59.301128 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Domain-Id: default Aug 01 16:38:59.301128 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Domain-Name: Default Aug 01 16:38:59.301128 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Id: 7ebe8558580445f1806be8be7398e2c7 Aug 01 16:38:59.301128 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Name: tempest-VolumesNegativeTest-442109307-project Aug 01 16:38:59.301128 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Aug 01 16:38:59.301128 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2111882478", "metadata": {"Type": "work"}}} Aug 01 16:38:59.301128 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: method: Aug 01 16:38:59.301128 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 01 16:38:59.301882 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2111882478', 'metadata': {'Type': 'work'}}}} Aug 01 16:38:59.301882 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:38:59.301882 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:38:59.301882 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 01 16:38:59.301882 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 01 16:38:59.301882 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 01 16:38:59.301882 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise error Aug 01 16:38:59.301882 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 01 16:38:59.301882 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:38:59.301882 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 01 16:38:59.301882 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 01 16:38:59.301882 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:38:59.301882 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 01 16:38:59.301882 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi '0' Aug 01 16:38:59.301882 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:38:59.301882 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:38:59.301882 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:38:59.301882 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:38:59.301882 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:38:59.301882 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:38:59.301882 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:38:59.301882 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:38:59.303403 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 16:38:59.303403 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 16:38:59.303403 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:38:59.303403 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:38:59.303403 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 01 16:38:59.303403 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 01 16:38:59.303403 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 01 16:38:59.303403 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 01 16:38:59.303403 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 01 16:38:59.303403 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 01 16:38:59.303403 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 01 16:38:59.303403 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:38:59.303403 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:38:59.303403 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:38:59.303403 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:38:59.303403 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:38:59.303403 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:38:59.303403 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 01 16:38:59.303403 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 01 16:38:59.305678 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 01 16:38:59.305678 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:38:59.305678 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-df33be10-72a6-48b7-a27f-55e2130a2e09 tempest-VolumesNegativeTest-442109307 tempest-VolumesNegativeTest-442109307-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118118) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:38:59.311333 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-df33be10-72a6-48b7-a27f-55e2130a2e09 tempest-VolumesNegativeTest-442109307 tempest-VolumesNegativeTest-442109307-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.536586 Aug 01 16:38:59.312586 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 1/2] 10.222.0.45 () {60 vars in 1156 bytes} [Mon Aug 1 16:38:58 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 542 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 01 16:38:59.322574 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-fa168191-6547-4811-9bda-b526309affb0 tempest-VolumesNegativeTest-442109307 tempest-VolumesNegativeTest-442109307-project] Action: 'create', calling method: .version_select at 0x7efd64b749d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1259250211", "metadata": {"Type": "work"}}} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:38:59.332392 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-fa168191-6547-4811-9bda-b526309affb0 tempest-VolumesNegativeTest-442109307 tempest-VolumesNegativeTest-442109307-project] Request method failure captured: Aug 01 16:38:59.332392 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 01 16:38:59.332392 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Accept: application/json Aug 01 16:38:59.332392 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Accept-Encoding: identity Aug 01 16:38:59.332392 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Connection: close Aug 01 16:38:59.332392 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Content-Length: 119 Aug 01 16:38:59.332392 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Content-Type: application/json Aug 01 16:38:59.332392 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Host: 10.222.0.45 Aug 01 16:38:59.332392 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Openstack-System-Scope: None Aug 01 16:38:59.332392 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: User-Agent: python-urllib3/1.26.10 Aug 01 16:38:59.332392 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Auth-Token: gAAAAABi6AGhuLhabQ3WR5ZNPEKJfnRsrRoaFZwVweZbJbXOaH95ZhaQUjXkFeqQe_t8ztf5HYeRZ2ZxZ_6X85h6R5l3tLnFhP9UiF8MCjPxghuo8QNZzEXl8VNqCr33upq7K-mZSXLhy-egiHUUG4rJBdA1vHsylzB8pUQ1PwKEJ1tOWLXPdEQ Aug 01 16:38:59.332392 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Domain-Id: None Aug 01 16:38:59.332392 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Domain-Name: None Aug 01 16:38:59.332392 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Identity-Status: Confirmed Aug 01 16:38:59.332392 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Is-Admin-Project: True Aug 01 16:38:59.332392 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Domain-Id: default Aug 01 16:38:59.332392 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Domain-Name: Default Aug 01 16:38:59.332392 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Id: 51b7e06f5b96485e8449852d67908bc1 Aug 01 16:38:59.332392 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Name: tempest-VolumesNegativeTest-442109307 Aug 01 16:38:59.332392 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Role: reader,member Aug 01 16:38:59.332392 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Roles: reader,member Aug 01 16:38:59.333760 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_51b7e06f5b96485e8449852d67908bc1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/51b7e06f5b96485e8449852d67908bc1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/51b7e06f5b96485e8449852d67908bc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/51b7e06f5b96485e8449852d67908bc1"}]}] Aug 01 16:38:59.333760 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Tenant: tempest-VolumesNegativeTest-442109307 Aug 01 16:38:59.333760 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Tenant-Id: 51b7e06f5b96485e8449852d67908bc1 Aug 01 16:38:59.333760 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Tenant-Name: tempest-VolumesNegativeTest-442109307 Aug 01 16:38:59.333760 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User: tempest-VolumesNegativeTest-442109307-project Aug 01 16:38:59.333760 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Domain-Id: default Aug 01 16:38:59.333760 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Domain-Name: Default Aug 01 16:38:59.333760 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Id: 7ebe8558580445f1806be8be7398e2c7 Aug 01 16:38:59.333760 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Name: tempest-VolumesNegativeTest-442109307-project Aug 01 16:38:59.333760 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Aug 01 16:38:59.333760 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1259250211", "metadata": {"Type": "work"}}} Aug 01 16:38:59.333760 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: method: Aug 01 16:38:59.333760 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 01 16:38:59.334729 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1259250211', 'metadata': {'Type': 'work'}}}} Aug 01 16:38:59.334729 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:38:59.334729 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:38:59.334729 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 01 16:38:59.334729 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 01 16:38:59.334729 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 01 16:38:59.334729 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi raise error Aug 01 16:38:59.334729 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 01 16:38:59.334729 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:38:59.334729 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 01 16:38:59.334729 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 01 16:38:59.334729 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:38:59.334729 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 01 16:38:59.334729 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi '' Aug 01 16:38:59.334729 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:38:59.334729 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:38:59.334729 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:38:59.334729 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:38:59.334729 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:38:59.334729 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:38:59.334729 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:38:59.334729 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:38:59.336722 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 16:38:59.336722 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 16:38:59.336722 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:38:59.336722 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:38:59.336722 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 01 16:38:59.336722 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 01 16:38:59.336722 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 01 16:38:59.336722 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 01 16:38:59.336722 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 01 16:38:59.336722 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 01 16:38:59.336722 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 01 16:38:59.336722 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:38:59.336722 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:38:59.336722 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:38:59.336722 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:38:59.336722 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:38:59.336722 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:38:59.336722 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 01 16:38:59.336722 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 01 16:38:59.338923 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 01 16:38:59.338923 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:38:59.338923 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-fa168191-6547-4811-9bda-b526309affb0 tempest-VolumesNegativeTest-442109307 tempest-VolumesNegativeTest-442109307-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118117) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:38:59.338923 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-fa168191-6547-4811-9bda-b526309affb0 tempest-VolumesNegativeTest-442109307 tempest-VolumesNegativeTest-442109307-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.015585 Aug 01 16:38:59.346537 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_api:SELECT=3 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:59.347185 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 2/3] 10.222.0.45 () {60 vars in 1156 bytes} [Mon Aug 1 16:38:59 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 01 16:38:59.347947 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_cell1:SELECT=3 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:59.348937 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_cell0:SELECT=3 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:59.350641 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_cell0:SELECT=3 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:38:59.358619 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-d05767ba-8610-431f-a07f-5b4204faa02f tempest-VolumesNegativeTest-442109307 tempest-VolumesNegativeTest-442109307-project] Calling method '.version_select at 0x7efd64cd0e50>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:39:00.201403 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.wsgi [None req-d05767ba-8610-431f-a07f-5b4204faa02f tempest-VolumesNegativeTest-442109307 tempest-VolumesNegativeTest-442109307-project] HTTP exception thrown: Volume tempest-invalid-2017529827 could not be found. Aug 01 16:39:00.229036 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-d05767ba-8610-431f-a07f-5b4204faa02f tempest-VolumesNegativeTest-442109307 tempest-VolumesNegativeTest-442109307-project] Request method failure captured: Aug 01 16:39:00.229036 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2017529827 HTTP/1.1 Aug 01 16:39:00.229036 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Accept: application/json Aug 01 16:39:00.229036 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Accept-Encoding: identity Aug 01 16:39:00.229036 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Connection: close Aug 01 16:39:00.229036 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Content-Length: 0 Aug 01 16:39:00.229036 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Content-Type: application/json Aug 01 16:39:00.229036 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Host: 10.222.0.45 Aug 01 16:39:00.229036 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Openstack-System-Scope: None Aug 01 16:39:00.229036 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: User-Agent: python-urllib3/1.26.10 Aug 01 16:39:00.229036 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Auth-Token: gAAAAABi6AGhuLhabQ3WR5ZNPEKJfnRsrRoaFZwVweZbJbXOaH95ZhaQUjXkFeqQe_t8ztf5HYeRZ2ZxZ_6X85h6R5l3tLnFhP9UiF8MCjPxghuo8QNZzEXl8VNqCr33upq7K-mZSXLhy-egiHUUG4rJBdA1vHsylzB8pUQ1PwKEJ1tOWLXPdEQ Aug 01 16:39:00.229036 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Domain-Id: None Aug 01 16:39:00.229036 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Domain-Name: None Aug 01 16:39:00.229036 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Identity-Status: Confirmed Aug 01 16:39:00.229036 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Is-Admin-Project: True Aug 01 16:39:00.229036 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Domain-Id: default Aug 01 16:39:00.229036 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Domain-Name: Default Aug 01 16:39:00.229036 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Id: 51b7e06f5b96485e8449852d67908bc1 Aug 01 16:39:00.229036 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Name: tempest-VolumesNegativeTest-442109307 Aug 01 16:39:00.229036 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Role: reader,member Aug 01 16:39:00.229036 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Roles: reader,member Aug 01 16:39:00.231868 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_51b7e06f5b96485e8449852d67908bc1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/51b7e06f5b96485e8449852d67908bc1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/51b7e06f5b96485e8449852d67908bc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/51b7e06f5b96485e8449852d67908bc1"}]}] Aug 01 16:39:00.231868 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant: tempest-VolumesNegativeTest-442109307 Aug 01 16:39:00.231868 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant-Id: 51b7e06f5b96485e8449852d67908bc1 Aug 01 16:39:00.231868 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant-Name: tempest-VolumesNegativeTest-442109307 Aug 01 16:39:00.231868 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User: tempest-VolumesNegativeTest-442109307-project Aug 01 16:39:00.231868 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Domain-Id: default Aug 01 16:39:00.231868 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Domain-Name: Default Aug 01 16:39:00.231868 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Id: 7ebe8558580445f1806be8be7398e2c7 Aug 01 16:39:00.231868 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Name: tempest-VolumesNegativeTest-442109307-project Aug 01 16:39:00.231868 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: method: Aug 01 16:39:00.231868 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: exception: Volume tempest-invalid-2017529827 could not be found. Aug 01 16:39:00.231868 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: action_args: {'id': 'tempest-invalid-2017529827'} Aug 01 16:39:00.231868 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:39:00.233294 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:39:00.233294 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 16:39:00.233294 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 16:39:00.233294 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 01 16:39:00.233294 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 01 16:39:00.233294 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 01 16:39:00.233294 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 01 16:39:00.233294 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 01 16:39:00.233294 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 01 16:39:00.233294 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 01 16:39:00.233294 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 01 16:39:00.233294 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 16:39:00.233294 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 16:39:00.233294 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 16:39:00.233294 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 16:39:00.233294 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2017529827 could not be found. (HTTP 404) (Request-ID: req-3af51836-f23b-467c-aacd-de2838c115f8) Aug 01 16:39:00.233294 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:39:00.233294 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:39:00.233294 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:39:00.235368 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:39:00.235368 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 01 16:39:00.235368 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 01 16:39:00.235368 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 16:39:00.235368 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 16:39:00.235368 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 16:39:00.235368 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 16:39:00.235368 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 16:39:00.235368 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 16:39:00.235368 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 16:39:00.235368 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 16:39:00.235368 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 01 16:39:00.235368 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 01 16:39:00.235368 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 01 16:39:00.235368 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 01 16:39:00.235368 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 01 16:39:00.235368 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 01 16:39:00.235368 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 01 16:39:00.235368 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 01 16:39:00.239193 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 16:39:00.239193 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 16:39:00.239193 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 16:39:00.239193 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 16:39:00.239193 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2017529827 could not be found. Aug 01 16:39:00.239193 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:39:00.239193 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:39:00.239193 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:39:00.239193 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:39:00.239193 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:39:00.239193 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:39:00.239193 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:39:00.239193 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:39:00.239193 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 16:39:00.239193 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 16:39:00.239193 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:39:00.239193 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:39:00.239193 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 01 16:39:00.239193 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:39:00.239193 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2017529827 could not be found. Aug 01 16:39:00.242317 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:39:00.242317 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:39:00.242317 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:39:00.242317 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:39:00.242317 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:39:00.242317 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:39:00.242317 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:39:00.242317 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:39:00.242317 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2017529827 could not be found. Aug 01 16:39:00.242317 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:39:00.247298 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-d05767ba-8610-431f-a07f-5b4204faa02f tempest-VolumesNegativeTest-442109307 tempest-VolumesNegativeTest-442109307-project] Returning 404 to user: Volume tempest-invalid-2017529827 could not be found. {{(pid=118118) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:39:00.254524 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-d05767ba-8610-431f-a07f-5b4204faa02f tempest-VolumesNegativeTest-442109307 tempest-VolumesNegativeTest-442109307-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2017529827" status: 404 len: 99 microversion: 2.1 time: 0.909043 Aug 01 16:39:00.258962 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 2/4] 10.222.0.45 () {58 vars in 1218 bytes} [Mon Aug 1 16:38:59 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2017529827 => generated 99 bytes in 915 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 01 16:39:00.269427 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-c9f497e1-f63f-4852-9aee-5b0357a11b0f tempest-VolumesNegativeTest-442109307 tempest-VolumesNegativeTest-442109307-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004135 Aug 01 16:39:00.275586 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 3/5] 10.222.0.45 () {58 vars in 1140 bytes} [Mon Aug 1 16:39:00 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 01 16:39:00.292743 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-d1bb7ca7-7a34-4047-92bb-8b709025da2a tempest-VolumesNegativeTest-442109307 tempest-VolumesNegativeTest-442109307-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004709 Aug 01 16:39:00.292743 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 3/6] 10.222.0.45 () {58 vars in 1137 bytes} [Mon Aug 1 16:39:00 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 01 16:39:00.298683 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-99703b96-6b01-44ed-9b29-4252baa8a1fe tempest-VolumesNegativeTest-442109307 tempest-VolumesNegativeTest-442109307-project] Calling method '.version_select at 0x7efd64b36ca0>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:39:00.751168 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.wsgi [None req-99703b96-6b01-44ed-9b29-4252baa8a1fe tempest-VolumesNegativeTest-442109307 tempest-VolumesNegativeTest-442109307-project] HTTP exception thrown: Volume a3a93141-2483-4263-b6d2-e16fb8e82dd8 could not be found. Aug 01 16:39:00.756936 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-99703b96-6b01-44ed-9b29-4252baa8a1fe tempest-VolumesNegativeTest-442109307 tempest-VolumesNegativeTest-442109307-project] Request method failure captured: Aug 01 16:39:00.756936 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: request: DELETE /compute/v2.1/os-volumes/a3a93141-2483-4263-b6d2-e16fb8e82dd8 HTTP/1.1 Aug 01 16:39:00.756936 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Accept: application/json Aug 01 16:39:00.756936 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Accept-Encoding: identity Aug 01 16:39:00.756936 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Connection: close Aug 01 16:39:00.756936 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Content-Length: 0 Aug 01 16:39:00.756936 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Content-Type: application/json Aug 01 16:39:00.756936 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Host: 10.222.0.45 Aug 01 16:39:00.756936 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Openstack-System-Scope: None Aug 01 16:39:00.756936 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: User-Agent: python-urllib3/1.26.10 Aug 01 16:39:00.756936 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Auth-Token: gAAAAABi6AGhuLhabQ3WR5ZNPEKJfnRsrRoaFZwVweZbJbXOaH95ZhaQUjXkFeqQe_t8ztf5HYeRZ2ZxZ_6X85h6R5l3tLnFhP9UiF8MCjPxghuo8QNZzEXl8VNqCr33upq7K-mZSXLhy-egiHUUG4rJBdA1vHsylzB8pUQ1PwKEJ1tOWLXPdEQ Aug 01 16:39:00.756936 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Domain-Id: None Aug 01 16:39:00.756936 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Domain-Name: None Aug 01 16:39:00.756936 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Identity-Status: Confirmed Aug 01 16:39:00.756936 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Is-Admin-Project: True Aug 01 16:39:00.756936 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Domain-Id: default Aug 01 16:39:00.756936 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Domain-Name: Default Aug 01 16:39:00.756936 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Id: 51b7e06f5b96485e8449852d67908bc1 Aug 01 16:39:00.756936 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Name: tempest-VolumesNegativeTest-442109307 Aug 01 16:39:00.756936 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Role: reader,member Aug 01 16:39:00.756936 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Roles: reader,member Aug 01 16:39:00.758319 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_51b7e06f5b96485e8449852d67908bc1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/51b7e06f5b96485e8449852d67908bc1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/51b7e06f5b96485e8449852d67908bc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/51b7e06f5b96485e8449852d67908bc1"}]}] Aug 01 16:39:00.758319 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Tenant: tempest-VolumesNegativeTest-442109307 Aug 01 16:39:00.758319 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Tenant-Id: 51b7e06f5b96485e8449852d67908bc1 Aug 01 16:39:00.758319 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Tenant-Name: tempest-VolumesNegativeTest-442109307 Aug 01 16:39:00.758319 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User: tempest-VolumesNegativeTest-442109307-project Aug 01 16:39:00.758319 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Domain-Id: default Aug 01 16:39:00.758319 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Domain-Name: Default Aug 01 16:39:00.758319 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Id: 7ebe8558580445f1806be8be7398e2c7 Aug 01 16:39:00.758319 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Name: tempest-VolumesNegativeTest-442109307-project Aug 01 16:39:00.758319 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: method: Aug 01 16:39:00.758319 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: exception: Volume a3a93141-2483-4263-b6d2-e16fb8e82dd8 could not be found. Aug 01 16:39:00.758319 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: action_args: {'id': 'a3a93141-2483-4263-b6d2-e16fb8e82dd8'} Aug 01 16:39:00.758319 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:39:00.758954 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:39:00.758954 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 16:39:00.758954 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 16:39:00.758954 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 01 16:39:00.758954 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 01 16:39:00.758954 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 01 16:39:00.758954 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 01 16:39:00.758954 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 01 16:39:00.758954 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 01 16:39:00.758954 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 01 16:39:00.758954 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 01 16:39:00.758954 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 16:39:00.758954 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 16:39:00.758954 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 16:39:00.758954 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 16:39:00.758954 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a3a93141-2483-4263-b6d2-e16fb8e82dd8 could not be found. (HTTP 404) (Request-ID: req-eba52366-896e-418c-bb6f-c049e504255f) Aug 01 16:39:00.758954 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:39:00.758954 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:39:00.758954 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:39:00.759839 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:39:00.759839 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 01 16:39:00.759839 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 01 16:39:00.759839 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 16:39:00.759839 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 16:39:00.759839 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 16:39:00.759839 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 16:39:00.759839 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 16:39:00.759839 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 16:39:00.759839 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 16:39:00.759839 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 16:39:00.759839 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 01 16:39:00.759839 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 01 16:39:00.759839 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 01 16:39:00.759839 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 01 16:39:00.759839 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 01 16:39:00.759839 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 01 16:39:00.759839 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 01 16:39:00.759839 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 01 16:39:00.760793 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 16:39:00.760793 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 16:39:00.760793 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 16:39:00.760793 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 16:39:00.760793 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a3a93141-2483-4263-b6d2-e16fb8e82dd8 could not be found. Aug 01 16:39:00.760793 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:39:00.760793 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:39:00.760793 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:39:00.760793 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:39:00.760793 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:39:00.760793 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:39:00.760793 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:39:00.760793 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:39:00.760793 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 16:39:00.760793 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 16:39:00.760793 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:39:00.760793 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:39:00.760793 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 01 16:39:00.760793 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:39:00.761595 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a3a93141-2483-4263-b6d2-e16fb8e82dd8 could not be found. Aug 01 16:39:00.761595 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:39:00.761595 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:39:00.761595 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:39:00.761595 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:39:00.761595 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:39:00.761595 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:39:00.761595 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:39:00.761595 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:39:00.761595 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a3a93141-2483-4263-b6d2-e16fb8e82dd8 could not be found. Aug 01 16:39:00.761595 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:39:00.766337 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-99703b96-6b01-44ed-9b29-4252baa8a1fe tempest-VolumesNegativeTest-442109307 tempest-VolumesNegativeTest-442109307-project] Returning 404 to user: Volume a3a93141-2483-4263-b6d2-e16fb8e82dd8 could not be found. {{(pid=118117) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:39:00.768046 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-99703b96-6b01-44ed-9b29-4252baa8a1fe tempest-VolumesNegativeTest-442109307 tempest-VolumesNegativeTest-442109307-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/a3a93141-2483-4263-b6d2-e16fb8e82dd8" status: 404 len: 109 microversion: 2.1 time: 0.474117 Aug 01 16:39:00.774110 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 4/7] 10.222.0.45 () {58 vars in 1248 bytes} [Mon Aug 1 16:39:00 2022] DELETE /compute/v2.1/os-volumes/a3a93141-2483-4263-b6d2-e16fb8e82dd8 => generated 109 bytes in 481 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 16:39:00.779739 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-6ba4c6f8-e6a8-4805-9911-8281ec8bacd1 tempest-VolumesNegativeTest-442109307 tempest-VolumesNegativeTest-442109307-project] Calling method '.version_select at 0x7efd64a6da60>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:39:00.843354 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.wsgi [None req-6ba4c6f8-e6a8-4805-9911-8281ec8bacd1 tempest-VolumesNegativeTest-442109307 tempest-VolumesNegativeTest-442109307-project] HTTP exception thrown: Volume d0bf0f07-54a0-4a90-9c86-625365cbf88b could not be found. Aug 01 16:39:00.845533 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-6ba4c6f8-e6a8-4805-9911-8281ec8bacd1 tempest-VolumesNegativeTest-442109307 tempest-VolumesNegativeTest-442109307-project] Request method failure captured: Aug 01 16:39:00.845533 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: request: GET /compute/v2.1/os-volumes/d0bf0f07-54a0-4a90-9c86-625365cbf88b HTTP/1.1 Aug 01 16:39:00.845533 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Accept: application/json Aug 01 16:39:00.845533 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Accept-Encoding: identity Aug 01 16:39:00.845533 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Connection: close Aug 01 16:39:00.845533 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Content-Length: 0 Aug 01 16:39:00.845533 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Content-Type: application/json Aug 01 16:39:00.845533 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Host: 10.222.0.45 Aug 01 16:39:00.845533 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Openstack-System-Scope: None Aug 01 16:39:00.845533 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: User-Agent: python-urllib3/1.26.10 Aug 01 16:39:00.845533 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Auth-Token: gAAAAABi6AGhuLhabQ3WR5ZNPEKJfnRsrRoaFZwVweZbJbXOaH95ZhaQUjXkFeqQe_t8ztf5HYeRZ2ZxZ_6X85h6R5l3tLnFhP9UiF8MCjPxghuo8QNZzEXl8VNqCr33upq7K-mZSXLhy-egiHUUG4rJBdA1vHsylzB8pUQ1PwKEJ1tOWLXPdEQ Aug 01 16:39:00.845533 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Domain-Id: None Aug 01 16:39:00.845533 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Domain-Name: None Aug 01 16:39:00.845533 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Identity-Status: Confirmed Aug 01 16:39:00.845533 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Is-Admin-Project: True Aug 01 16:39:00.845533 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Domain-Id: default Aug 01 16:39:00.845533 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Domain-Name: Default Aug 01 16:39:00.845533 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Id: 51b7e06f5b96485e8449852d67908bc1 Aug 01 16:39:00.845533 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Name: tempest-VolumesNegativeTest-442109307 Aug 01 16:39:00.845533 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Role: reader,member Aug 01 16:39:00.845533 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Roles: reader,member Aug 01 16:39:00.846775 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_51b7e06f5b96485e8449852d67908bc1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/51b7e06f5b96485e8449852d67908bc1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/51b7e06f5b96485e8449852d67908bc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/51b7e06f5b96485e8449852d67908bc1"}]}] Aug 01 16:39:00.846775 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant: tempest-VolumesNegativeTest-442109307 Aug 01 16:39:00.846775 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant-Id: 51b7e06f5b96485e8449852d67908bc1 Aug 01 16:39:00.846775 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant-Name: tempest-VolumesNegativeTest-442109307 Aug 01 16:39:00.846775 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User: tempest-VolumesNegativeTest-442109307-project Aug 01 16:39:00.846775 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Domain-Id: default Aug 01 16:39:00.846775 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Domain-Name: Default Aug 01 16:39:00.846775 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Id: 7ebe8558580445f1806be8be7398e2c7 Aug 01 16:39:00.846775 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Name: tempest-VolumesNegativeTest-442109307-project Aug 01 16:39:00.846775 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: method: Aug 01 16:39:00.846775 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: exception: Volume d0bf0f07-54a0-4a90-9c86-625365cbf88b could not be found. Aug 01 16:39:00.846775 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: action_args: {'id': 'd0bf0f07-54a0-4a90-9c86-625365cbf88b'} Aug 01 16:39:00.846775 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:39:00.847506 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:39:00.847506 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 16:39:00.847506 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 16:39:00.847506 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 16:39:00.847506 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 16:39:00.847506 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 16:39:00.847506 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 16:39:00.847506 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 16:39:00.847506 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 16:39:00.847506 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 16:39:00.847506 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 16:39:00.847506 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 16:39:00.847506 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 16:39:00.847506 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 16:39:00.847506 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 16:39:00.847506 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d0bf0f07-54a0-4a90-9c86-625365cbf88b could not be found. (HTTP 404) (Request-ID: req-9589572e-2974-453c-87e6-a02adec7a09f) Aug 01 16:39:00.847506 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:39:00.847506 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:39:00.847506 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:39:00.848525 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:39:00.848525 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 01 16:39:00.848525 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 01 16:39:00.848525 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 16:39:00.848525 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 16:39:00.848525 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 16:39:00.848525 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 16:39:00.848525 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 16:39:00.848525 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 16:39:00.848525 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 16:39:00.848525 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 16:39:00.848525 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 16:39:00.848525 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 16:39:00.848525 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 16:39:00.848525 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 16:39:00.848525 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 16:39:00.848525 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 16:39:00.848525 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 16:39:00.848525 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 16:39:00.849442 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 16:39:00.849442 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 16:39:00.849442 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 16:39:00.849442 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 16:39:00.849442 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d0bf0f07-54a0-4a90-9c86-625365cbf88b could not be found. Aug 01 16:39:00.849442 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:39:00.849442 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:39:00.849442 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:39:00.849442 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:39:00.849442 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:39:00.849442 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:39:00.849442 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:39:00.849442 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:39:00.849442 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 16:39:00.849442 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 16:39:00.849442 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:39:00.849442 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:39:00.849442 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 01 16:39:00.849442 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:39:00.850312 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d0bf0f07-54a0-4a90-9c86-625365cbf88b could not be found. Aug 01 16:39:00.850312 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:39:00.850312 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:39:00.850312 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:39:00.850312 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:39:00.850312 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:39:00.850312 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:39:00.850312 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:39:00.850312 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:39:00.850312 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d0bf0f07-54a0-4a90-9c86-625365cbf88b could not be found. Aug 01 16:39:00.850312 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:39:00.851999 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-6ba4c6f8-e6a8-4805-9911-8281ec8bacd1 tempest-VolumesNegativeTest-442109307 tempest-VolumesNegativeTest-442109307-project] Returning 404 to user: Volume d0bf0f07-54a0-4a90-9c86-625365cbf88b could not be found. {{(pid=118118) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:39:00.853017 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-6ba4c6f8-e6a8-4805-9911-8281ec8bacd1 tempest-VolumesNegativeTest-442109307 tempest-VolumesNegativeTest-442109307-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/d0bf0f07-54a0-4a90-9c86-625365cbf88b" status: 404 len: 109 microversion: 2.1 time: 0.077471 Aug 01 16:39:00.854049 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 4/8] 10.222.0.45 () {58 vars in 1245 bytes} [Mon Aug 1 16:39:00 2022] GET /compute/v2.1/os-volumes/d0bf0f07-54a0-4a90-9c86-625365cbf88b => generated 109 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 16:39:11.650330 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-2cb689e3-dc5b-4748-963c-75442c319212 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-704692284", "imageRef": "c9cb5329-85cb-4472-935d-c4ea1d1f0592", "flavorRef": "452", "networks": [{"uuid": "4ad5f69b-e731-48af-88d4-83a0f8ed7438"}]}} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:39:12.081758 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.network.neutron [None req-2cb689e3-dc5b-4748-963c-75442c319212 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] validate_networks() for [('4ad5f69b-e731-48af-88d4-83a0f8ed7438', None, None, None, None, None)] {{(pid=118117) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 16:39:13.805701 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.virt.hardware [None req-2cb689e3-dc5b-4748-963c-75442c319212 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Flavor limits 0:0:0 {{(pid=118117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 16:39:13.806920 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.virt.hardware [None req-2cb689e3-dc5b-4748-963c-75442c319212 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Image limits 0:0:0 {{(pid=118117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 16:39:13.807576 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.virt.hardware [None req-2cb689e3-dc5b-4748-963c-75442c319212 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Flavor pref 0:0:0 {{(pid=118117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 16:39:13.808226 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.virt.hardware [None req-2cb689e3-dc5b-4748-963c-75442c319212 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Image pref 0:0:0 {{(pid=118117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 16:39:13.808921 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.virt.hardware [None req-2cb689e3-dc5b-4748-963c-75442c319212 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 16:39:13.846922 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-2cb689e3-dc5b-4748-963c-75442c319212 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:13.847370 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-2cb689e3-dc5b-4748-963c-75442c319212 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:13.860756 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-2cb689e3-dc5b-4748-963c-75442c319212 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:13.861220 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-2cb689e3-dc5b-4748-963c-75442c319212 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:13.936626 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.quota [None req-2cb689e3-dc5b-4748-963c-75442c319212 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Getting quotas for project c6d1d41a90df4eb8ae7b9a3934629614. Resources: {'cores', 'ram', 'instances'} {{(pid=118117) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 16:39:13.982839 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.quota [None req-2cb689e3-dc5b-4748-963c-75442c319212 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Getting quotas for user 7a310f36f74e4eaabd9f32220feb274a and project c6d1d41a90df4eb8ae7b9a3934629614. Resources: {'cores', 'ram', 'instances'} {{(pid=118117) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 16:39:14.028878 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-2cb689e3-dc5b-4748-963c-75442c319212 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Going to run 1 instances... {{(pid=118117) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 16:39:14.036832 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-2cb689e3-dc5b-4748-963c-75442c319212 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] [instance: 97a3e151-77b3-424a-9e0c-8fd838b8fe23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c9cb5329-85cb-4472-935d-c4ea1d1f0592',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118117) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 16:39:14.208491 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-2cb689e3-dc5b-4748-963c-75442c319212 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.038264 Aug 01 16:39:14.210911 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 5/9] 10.222.0.45 () {60 vars in 1147 bytes} [Mon Aug 1 16:39:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 3042 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 16:39:14.249960 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-4b573a57-3040-4a52-a42b-1fee453e1b9d tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:39:14.252513 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-4b573a57-3040-4a52-a42b-1fee453e1b9d tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] [instance: 97a3e151-77b3-424a-9e0c-8fd838b8fe23] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:39:14.987434 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-fb950ab7-8581-4c14-a8f7-5a12442dafe6 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Action: 'create', calling method: .version_select at 0x7efd64176e50>, body: {"keypair": {"name": "tempest-keypair-722654932", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJI8fa5RcLBGJECr6RkqTVMMBF+kuPxwHTWMlkhRh5DbUjsJe16VOQJaZ9ALLSYeMENbeJ/l5XlA43pkivPmqnyv0O7rpBqkK0mwePs/p+wk1J3HZFaL1DMjCtvfiF4lIg=="}} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:39:15.174426 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.quota [None req-fb950ab7-8581-4c14-a8f7-5a12442dafe6 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Getting quotas for project 1b66d46c3e7d42b88f2dbdc01232fb03. Resources: {'key_pairs'} {{(pid=118117) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 16:39:15.206387 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.quota [None req-fb950ab7-8581-4c14-a8f7-5a12442dafe6 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Getting quotas for user 4b0aed0278344119aae6906f4f52b1e5 and project 1b66d46c3e7d42b88f2dbdc01232fb03. Resources: {'key_pairs'} {{(pid=118117) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 16:39:15.363303 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-fb950ab7-8581-4c14-a8f7-5a12442dafe6 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.953934 Aug 01 16:39:15.364571 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 6/10] 10.222.0.45 () {60 vars in 1159 bytes} [Mon Aug 1 16:39:14 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:39:15.599418 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-4b573a57-3040-4a52-a42b-1fee453e1b9d tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a310f36f74e4eaabd9f32220feb274a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d1d41a90df4eb8ae7b9a3934629614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:39:15.658608 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-4b573a57-3040-4a52-a42b-1fee453e1b9d tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] 10.222.0.45 "GET /compute/v2.1/servers/97a3e151-77b3-424a-9e0c-8fd838b8fe23" status: 200 len: 1214 microversion: 2.1 time: 1.434821 Aug 01 16:39:15.661264 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 5/11] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:39:14 2022] GET /compute/v2.1/servers/97a3e151-77b3-424a-9e0c-8fd838b8fe23 => generated 1214 bytes in 1442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:39:16.685716 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-15f73d73-183c-4391-89fa-68d0c4282f6f tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:39:16.686896 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-15f73d73-183c-4391-89fa-68d0c4282f6f tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] [instance: 97a3e151-77b3-424a-9e0c-8fd838b8fe23] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:39:16.843527 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-15f73d73-183c-4391-89fa-68d0c4282f6f tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a310f36f74e4eaabd9f32220feb274a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d1d41a90df4eb8ae7b9a3934629614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:39:16.879847 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-15f73d73-183c-4391-89fa-68d0c4282f6f tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] 10.222.0.45 "GET /compute/v2.1/servers/97a3e151-77b3-424a-9e0c-8fd838b8fe23" status: 200 len: 1214 microversion: 2.1 time: 0.199173 Aug 01 16:39:16.897071 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 7/12] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:39:16 2022] GET /compute/v2.1/servers/97a3e151-77b3-424a-9e0c-8fd838b8fe23 => generated 1214 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:39:17.908927 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-22bed938-794f-4cbf-9a06-58c242f68329 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:39:17.914382 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-22bed938-794f-4cbf-9a06-58c242f68329 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] [instance: 97a3e151-77b3-424a-9e0c-8fd838b8fe23] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:39:17.936061 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-22bed938-794f-4cbf-9a06-58c242f68329 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:17.937450 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-22bed938-794f-4cbf-9a06-58c242f68329 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:17.939322 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-22bed938-794f-4cbf-9a06-58c242f68329 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:17.940705 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-22bed938-794f-4cbf-9a06-58c242f68329 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:18.930094 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-22bed938-794f-4cbf-9a06-58c242f68329 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a310f36f74e4eaabd9f32220feb274a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d1d41a90df4eb8ae7b9a3934629614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:39:18.981229 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-22bed938-794f-4cbf-9a06-58c242f68329 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] 10.222.0.45 "GET /compute/v2.1/servers/97a3e151-77b3-424a-9e0c-8fd838b8fe23" status: 200 len: 1210 microversion: 2.1 time: 1.081473 Aug 01 16:39:19.002899 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 6/13] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:39:17 2022] GET /compute/v2.1/servers/97a3e151-77b3-424a-9e0c-8fd838b8fe23 => generated 1210 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:39:20.031016 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-1dacdbee-76cb-44a3-9e97-fcec460ca147 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:39:20.032707 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-1dacdbee-76cb-44a3-9e97-fcec460ca147 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] [instance: 97a3e151-77b3-424a-9e0c-8fd838b8fe23] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:39:20.112267 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-1dacdbee-76cb-44a3-9e97-fcec460ca147 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:20.113388 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-1dacdbee-76cb-44a3-9e97-fcec460ca147 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:20.116855 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-1dacdbee-76cb-44a3-9e97-fcec460ca147 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:20.121804 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-1dacdbee-76cb-44a3-9e97-fcec460ca147 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:21.767440 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-1dacdbee-76cb-44a3-9e97-fcec460ca147 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a310f36f74e4eaabd9f32220feb274a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d1d41a90df4eb8ae7b9a3934629614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:39:21.856654 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-1dacdbee-76cb-44a3-9e97-fcec460ca147 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] 10.222.0.45 "GET /compute/v2.1/servers/97a3e151-77b3-424a-9e0c-8fd838b8fe23" status: 200 len: 1272 microversion: 2.1 time: 1.848685 Aug 01 16:39:21.862317 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 8/14] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:39:20 2022] GET /compute/v2.1/servers/97a3e151-77b3-424a-9e0c-8fd838b8fe23 => generated 1272 bytes in 1856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:39:22.904615 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-5f402c03-7619-4e12-820b-6263da4c979a tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:39:22.905507 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-5f402c03-7619-4e12-820b-6263da4c979a tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] [instance: 97a3e151-77b3-424a-9e0c-8fd838b8fe23] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:39:22.953956 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-5f402c03-7619-4e12-820b-6263da4c979a tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:22.959401 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-5f402c03-7619-4e12-820b-6263da4c979a tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:22.961533 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-5f402c03-7619-4e12-820b-6263da4c979a tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:22.982627 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-5f402c03-7619-4e12-820b-6263da4c979a tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:23.884870 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-5f402c03-7619-4e12-820b-6263da4c979a tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a310f36f74e4eaabd9f32220feb274a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d1d41a90df4eb8ae7b9a3934629614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:39:23.925261 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-5f402c03-7619-4e12-820b-6263da4c979a tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] 10.222.0.45 "GET /compute/v2.1/servers/97a3e151-77b3-424a-9e0c-8fd838b8fe23" status: 200 len: 1272 microversion: 2.1 time: 1.026058 Aug 01 16:39:23.937298 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 7/15] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:39:22 2022] GET /compute/v2.1/servers/97a3e151-77b3-424a-9e0c-8fd838b8fe23 => generated 1272 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:39:24.952122 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-fabbe759-b8c0-461e-9a45-85badd198490 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:39:24.954475 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-fabbe759-b8c0-461e-9a45-85badd198490 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] [instance: 97a3e151-77b3-424a-9e0c-8fd838b8fe23] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:39:24.967880 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_cell0:SELECT=2 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:24.982305 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-fabbe759-b8c0-461e-9a45-85badd198490 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:24.986169 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-fabbe759-b8c0-461e-9a45-85badd198490 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:24.991525 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-fabbe759-b8c0-461e-9a45-85badd198490 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:24.992619 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-fabbe759-b8c0-461e-9a45-85badd198490 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:25.206526 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-fabbe759-b8c0-461e-9a45-85badd198490 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a310f36f74e4eaabd9f32220feb274a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d1d41a90df4eb8ae7b9a3934629614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:39:25.222771 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-fabbe759-b8c0-461e-9a45-85badd198490 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] 10.222.0.45 "GET /compute/v2.1/servers/97a3e151-77b3-424a-9e0c-8fd838b8fe23" status: 200 len: 1272 microversion: 2.1 time: 0.274849 Aug 01 16:39:25.223952 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 9/16] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:39:24 2022] GET /compute/v2.1/servers/97a3e151-77b3-424a-9e0c-8fd838b8fe23 => generated 1272 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:39:26.252402 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-4549249b-0eb0-421a-bdc7-b89ee8e04d10 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:39:26.255095 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-4549249b-0eb0-421a-bdc7-b89ee8e04d10 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] [instance: 97a3e151-77b3-424a-9e0c-8fd838b8fe23] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:39:26.275145 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_cell0:SELECT=2 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:26.284359 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-4549249b-0eb0-421a-bdc7-b89ee8e04d10 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:26.288267 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-4549249b-0eb0-421a-bdc7-b89ee8e04d10 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:26.289715 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-4549249b-0eb0-421a-bdc7-b89ee8e04d10 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:26.292584 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-4549249b-0eb0-421a-bdc7-b89ee8e04d10 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:27.412588 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_cell0:SELECT=12 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:28.256304 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-4549249b-0eb0-421a-bdc7-b89ee8e04d10 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a310f36f74e4eaabd9f32220feb274a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d1d41a90df4eb8ae7b9a3934629614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:39:28.298493 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-4549249b-0eb0-421a-bdc7-b89ee8e04d10 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] 10.222.0.45 "GET /compute/v2.1/servers/97a3e151-77b3-424a-9e0c-8fd838b8fe23" status: 200 len: 1314 microversion: 2.1 time: 2.049104 Aug 01 16:39:28.340130 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 8/17] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:39:26 2022] GET /compute/v2.1/servers/97a3e151-77b3-424a-9e0c-8fd838b8fe23 => generated 1314 bytes in 2093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:39:28.430519 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-58e56c07-a4d1-40cf-b8df-91009bc35bb2 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Action: 'create', calling method: .version_select at 0x7efd6408ce50>, body: {"keypair": {"name": "tempest-keypair-811461864", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK+OPtl/zyWNMq95qLDlgoQ/sCz922gDRSe9CSX/r/heLPHfJcETqz73Pk+mKfhZTT2MCNjL3QQqxlY6E7RzhhcTeslaAbm1JRdsJIBMsHI+h3QJQez1+RFVVjsy2b4lFw=="}} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:39:28.480161 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.quota [None req-58e56c07-a4d1-40cf-b8df-91009bc35bb2 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Getting quotas for project 4c1c9729df694f46987e6dd30a09d5d2. Resources: {'key_pairs'} {{(pid=118117) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 16:39:28.498033 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.quota [None req-58e56c07-a4d1-40cf-b8df-91009bc35bb2 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Getting quotas for user 76c1fab92b854cd8937cc80818159191 and project 4c1c9729df694f46987e6dd30a09d5d2. Resources: {'key_pairs'} {{(pid=118117) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 16:39:28.581129 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-58e56c07-a4d1-40cf-b8df-91009bc35bb2 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 1.169871 Aug 01 16:39:28.582173 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 10/18] 10.222.0.45 () {62 vars in 1200 bytes} [Mon Aug 1 16:39:27 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1172 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 01 16:39:29.355669 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-9c72d041-eaef-4520-8355-9a07d03abd24 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:39:29.356746 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-9c72d041-eaef-4520-8355-9a07d03abd24 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] [instance: 97a3e151-77b3-424a-9e0c-8fd838b8fe23] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:39:29.410107 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-9c72d041-eaef-4520-8355-9a07d03abd24 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:29.410947 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-9c72d041-eaef-4520-8355-9a07d03abd24 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:29.423252 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-9c72d041-eaef-4520-8355-9a07d03abd24 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:29.425791 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-9c72d041-eaef-4520-8355-9a07d03abd24 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:30.349742 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-9c72d041-eaef-4520-8355-9a07d03abd24 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a310f36f74e4eaabd9f32220feb274a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d1d41a90df4eb8ae7b9a3934629614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:39:30.396478 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-9c72d041-eaef-4520-8355-9a07d03abd24 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] 10.222.0.45 "GET /compute/v2.1/servers/97a3e151-77b3-424a-9e0c-8fd838b8fe23" status: 200 len: 1314 microversion: 2.1 time: 1.048161 Aug 01 16:39:30.420313 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 9/19] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:39:29 2022] GET /compute/v2.1/servers/97a3e151-77b3-424a-9e0c-8fd838b8fe23 => generated 1314 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:39:30.434039 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-f01e66ac-8466-492b-91c2-ab3d1c1b0bd4 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-603870205", "imageRef": "c9cb5329-85cb-4472-935d-c4ea1d1f0592", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c300be66-e5b5-45ad-b400-2cd95bf6b7d7"}], "security_groups": [{"name": "tempest-securitygroup--2025936251"}], "key_name": "tempest-keypair-722654932", "user_data": "}} {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:39:31.252320 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.network.neutron [None req-f01e66ac-8466-492b-91c2-ab3d1c1b0bd4 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] validate_networks() for [('c300be66-e5b5-45ad-b400-2cd95bf6b7d7', None, None, None, None, None)] {{(pid=118118) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 16:39:31.533639 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-315816f8-a09f-40be-b907-0a086f00bef7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-654321933", "imageRef": "c9cb5329-85cb-4472-935d-c4ea1d1f0592", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:39:31.794469 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.network.neutron [None req-315816f8-a09f-40be-b907-0a086f00bef7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] validate_networks() for [('60ce50c8-8e76-4dd8-a571-dff5507254cd', None, None, None, None, None)] {{(pid=118117) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 16:39:34.737308 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.virt.hardware [None req-315816f8-a09f-40be-b907-0a086f00bef7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Flavor limits 0:0:0 {{(pid=118117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 16:39:34.738438 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.virt.hardware [None req-315816f8-a09f-40be-b907-0a086f00bef7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Image limits 0:0:0 {{(pid=118117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 16:39:34.739592 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.virt.hardware [None req-315816f8-a09f-40be-b907-0a086f00bef7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Flavor pref 0:0:0 {{(pid=118117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 16:39:34.740693 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.virt.hardware [None req-315816f8-a09f-40be-b907-0a086f00bef7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Image pref 0:0:0 {{(pid=118117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 16:39:34.742001 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.virt.hardware [None req-315816f8-a09f-40be-b907-0a086f00bef7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 16:39:34.790122 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-315816f8-a09f-40be-b907-0a086f00bef7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:34.794953 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-315816f8-a09f-40be-b907-0a086f00bef7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:34.804600 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-315816f8-a09f-40be-b907-0a086f00bef7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:34.808926 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-315816f8-a09f-40be-b907-0a086f00bef7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:34.996455 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.quota [None req-315816f8-a09f-40be-b907-0a086f00bef7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Getting quotas for project dbd6814591334db58a37092eb04729fb. Resources: {'cores', 'ram', 'instances'} {{(pid=118117) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 16:39:35.015712 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.quota [None req-315816f8-a09f-40be-b907-0a086f00bef7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Getting quotas for user 4294d6dff5054da7afcb37b8b28f1a01 and project dbd6814591334db58a37092eb04729fb. Resources: {'cores', 'ram', 'instances'} {{(pid=118117) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 16:39:35.125227 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-315816f8-a09f-40be-b907-0a086f00bef7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Going to run 1 instances... {{(pid=118117) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 16:39:35.132714 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-315816f8-a09f-40be-b907-0a086f00bef7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: ddf9be16-b3ce-411b-ac14-17dae5f41821] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c9cb5329-85cb-4472-935d-c4ea1d1f0592',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118117) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 16:39:35.348138 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-315816f8-a09f-40be-b907-0a086f00bef7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.417969 Aug 01 16:39:35.357886 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 11/20] 10.222.0.45 () {60 vars in 1147 bytes} [Mon Aug 1 16:39:29 2022] POST /compute/v2.1/servers => generated 383 bytes in 5429 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 16:39:35.771796 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.virt.hardware [None req-f01e66ac-8466-492b-91c2-ab3d1c1b0bd4 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Flavor limits 0:0:0 {{(pid=118118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 16:39:35.774023 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.virt.hardware [None req-f01e66ac-8466-492b-91c2-ab3d1c1b0bd4 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Image limits 0:0:0 {{(pid=118118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 16:39:35.775113 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.virt.hardware [None req-f01e66ac-8466-492b-91c2-ab3d1c1b0bd4 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Flavor pref 0:0:0 {{(pid=118118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 16:39:35.776078 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.virt.hardware [None req-f01e66ac-8466-492b-91c2-ab3d1c1b0bd4 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Image pref 0:0:0 {{(pid=118118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 16:39:35.777006 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.virt.hardware [None req-f01e66ac-8466-492b-91c2-ab3d1c1b0bd4 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 16:39:35.862552 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-f01e66ac-8466-492b-91c2-ab3d1c1b0bd4 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:35.863354 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-f01e66ac-8466-492b-91c2-ab3d1c1b0bd4 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:35.865639 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-f01e66ac-8466-492b-91c2-ab3d1c1b0bd4 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:35.866445 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-f01e66ac-8466-492b-91c2-ab3d1c1b0bd4 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:36.159073 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.quota [None req-f01e66ac-8466-492b-91c2-ab3d1c1b0bd4 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Getting quotas for project 1b66d46c3e7d42b88f2dbdc01232fb03. Resources: {'cores', 'ram', 'instances'} {{(pid=118118) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 16:39:36.185625 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.quota [None req-f01e66ac-8466-492b-91c2-ab3d1c1b0bd4 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Getting quotas for user 4b0aed0278344119aae6906f4f52b1e5 and project 1b66d46c3e7d42b88f2dbdc01232fb03. Resources: {'cores', 'ram', 'instances'} {{(pid=118118) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 16:39:36.220085 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-f01e66ac-8466-492b-91c2-ab3d1c1b0bd4 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Going to run 1 instances... {{(pid=118118) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 16:39:36.223158 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-f01e66ac-8466-492b-91c2-ab3d1c1b0bd4 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: a3f6b512-e3cb-4e87-8d82-c64f6f1640db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c9cb5329-85cb-4472-935d-c4ea1d1f0592',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118118) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 16:39:36.486890 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-3209bf25-2a32-4234-9432-16d04fac81cd tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Action: 'create', calling method: .version_select at 0x7efd6402cd30>, body: {"keypair": {"name": "tempest-keypair-282676080", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBInFHlGGhsO43FQ55W21v5ZZ1nmiw+ZuHAj5bxh0whNB6TcKMkd6I04/dTPvqPefUnVMc3oyuW+UUOizXGuUYZF+UamG6FaBk6q4ruIc45WQEwZ4x/1yNK5sYLbt6i7oTQ=="}} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:39:36.560119 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.quota [None req-3209bf25-2a32-4234-9432-16d04fac81cd tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Getting quotas for project 2f46e472f8614c5e847ceb225cc9bff1. Resources: {'key_pairs'} {{(pid=118117) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 16:39:36.568538 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.quota [None req-3209bf25-2a32-4234-9432-16d04fac81cd tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Getting quotas for user 1ac7d3acf1204a9f98f9ee14c2b46a5e and project 2f46e472f8614c5e847ceb225cc9bff1. Resources: {'key_pairs'} {{(pid=118117) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 16:39:36.669431 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-3209bf25-2a32-4234-9432-16d04fac81cd tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.310109 Aug 01 16:39:36.670507 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 12/21] 10.222.0.45 () {60 vars in 1159 bytes} [Mon Aug 1 16:39:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:39:36.676987 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-dc7f58fe-b307-4b89-a5de-1dc7a578fbae tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:39:36.677693 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-dc7f58fe-b307-4b89-a5de-1dc7a578fbae tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] [instance: 97a3e151-77b3-424a-9e0c-8fd838b8fe23] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:39:36.710965 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-dc7f58fe-b307-4b89-a5de-1dc7a578fbae tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:36.711433 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-dc7f58fe-b307-4b89-a5de-1dc7a578fbae tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:36.712280 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-dc7f58fe-b307-4b89-a5de-1dc7a578fbae tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:36.712731 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-dc7f58fe-b307-4b89-a5de-1dc7a578fbae tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:36.769322 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-f01e66ac-8466-492b-91c2-ab3d1c1b0bd4 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 6.346962 Aug 01 16:39:36.770526 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 10/22] 10.222.0.45 () {60 vars in 1147 bytes} [Mon Aug 1 16:39:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 6349 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 16:39:38.084550 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [req-dc644371-9375-46cd-91ae-af4fba75b489 req-0d5a52dc-7428-4dd1-b6ab-65913f06a20a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97a3e151-77b3-424a-9e0c-8fd838b8fe23", "tag": "8ab1f8c1-69bb-4671-98fe-5bb145658c82"}]} {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:39:38.138288 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-dc644371-9375-46cd-91ae-af4fba75b489 req-0d5a52dc-7428-4dd1-b6ab-65913f06a20a service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:38.143448 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-dc644371-9375-46cd-91ae-af4fba75b489 req-0d5a52dc-7428-4dd1-b6ab-65913f06a20a service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:38.231947 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.compute.server_external_events [req-dc644371-9375-46cd-91ae-af4fba75b489 req-0d5a52dc-7428-4dd1-b6ab-65913f06a20a service nova] Creating event network-changed:8ab1f8c1-69bb-4671-98fe-5bb145658c82 for instance 97a3e151-77b3-424a-9e0c-8fd838b8fe23 on hv-cinder-85032 Aug 01 16:39:38.238444 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-dc644371-9375-46cd-91ae-af4fba75b489 req-0d5a52dc-7428-4dd1-b6ab-65913f06a20a service nova] Acquired lock "compute-rpcapi-router" {{(pid=118118) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 01 16:39:38.243438 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-f9efbb85-c8ec-4ee6-8c79-f42b7ab24ae4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:38.246658 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-f9efbb85-c8ec-4ee6-8c79-f42b7ab24ae4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:38.253143 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-f9efbb85-c8ec-4ee6-8c79-f42b7ab24ae4 None None] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:38.256083 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-f9efbb85-c8ec-4ee6-8c79-f42b7ab24ae4 None None] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:38.305438 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.compute.rpcapi [None req-f9efbb85-c8ec-4ee6-8c79-f42b7ab24ae4 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 01 16:39:38.309086 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-f9efbb85-c8ec-4ee6-8c79-f42b7ab24ae4 None None] Releasing lock "compute-rpcapi-router" {{(pid=118118) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 01 16:39:38.371711 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-dc7f58fe-b307-4b89-a5de-1dc7a578fbae tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a310f36f74e4eaabd9f32220feb274a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d1d41a90df4eb8ae7b9a3934629614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:39:38.381425 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-f9efbb85-c8ec-4ee6-8c79-f42b7ab24ae4 None None] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.608346 Aug 01 16:39:38.382923 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 11/23] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:39:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1612 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:39:38.397553 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-dc7f58fe-b307-4b89-a5de-1dc7a578fbae tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] 10.222.0.45 "GET /compute/v2.1/servers/97a3e151-77b3-424a-9e0c-8fd838b8fe23" status: 200 len: 1314 microversion: 2.1 time: 1.725305 Aug 01 16:39:38.398651 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 13/24] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:39:36 2022] GET /compute/v2.1/servers/97a3e151-77b3-424a-9e0c-8fd838b8fe23 => generated 1314 bytes in 1727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:39:38.401971 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-88a71be9-291b-477d-b840-9fb758b031f7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:39:38.406093 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-88a71be9-291b-477d-b840-9fb758b031f7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: ddf9be16-b3ce-411b-ac14-17dae5f41821] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:39:38.466155 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-e8477da8-b526-4b5e-89f2-2b660142f7dd tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:39:38.470850 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-e8477da8-b526-4b5e-89f2-2b660142f7dd tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: a3f6b512-e3cb-4e87-8d82-c64f6f1640db] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:39:39.059102 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-88a71be9-291b-477d-b840-9fb758b031f7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:39:39.102782 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-88a71be9-291b-477d-b840-9fb758b031f7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/ddf9be16-b3ce-411b-ac14-17dae5f41821" status: 200 len: 1221 microversion: 2.1 time: 0.713999 Aug 01 16:39:39.105454 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 12/25] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:39:38 2022] GET /compute/v2.1/servers/ddf9be16-b3ce-411b-ac14-17dae5f41821 => generated 1221 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:39:39.443456 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-0ae6b52a-c79b-4bd0-9cbd-88d7ad8f6c9d tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:39:39.455655 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-0ae6b52a-c79b-4bd0-9cbd-88d7ad8f6c9d tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] [instance: 97a3e151-77b3-424a-9e0c-8fd838b8fe23] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:39:39.471333 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-0ae6b52a-c79b-4bd0-9cbd-88d7ad8f6c9d tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:39.488757 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-0ae6b52a-c79b-4bd0-9cbd-88d7ad8f6c9d tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:39.498644 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-0ae6b52a-c79b-4bd0-9cbd-88d7ad8f6c9d tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:39.507085 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-0ae6b52a-c79b-4bd0-9cbd-88d7ad8f6c9d tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:39.551143 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-e8477da8-b526-4b5e-89f2-2b660142f7dd tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0aed0278344119aae6906f4f52b1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b66d46c3e7d42b88f2dbdc01232fb03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:39:39.654234 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-e8477da8-b526-4b5e-89f2-2b660142f7dd tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db" status: 200 len: 1236 microversion: 2.1 time: 1.237954 Aug 01 16:39:39.666036 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 14/26] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:39:38 2022] GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db => generated 1236 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:39:39.956313 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-c8baacff-8e17-4e0e-b767-eb5b34d04fa0 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1845627690", "imageRef": "c9cb5329-85cb-4472-935d-c4ea1d1f0592", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:39:40.349864 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.network.neutron [None req-c8baacff-8e17-4e0e-b767-eb5b34d04fa0 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] validate_networks() for [('60ce50c8-8e76-4dd8-a571-dff5507254cd', None, None, None, None, None)] {{(pid=118117) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 16:39:41.120974 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-0ae6b52a-c79b-4bd0-9cbd-88d7ad8f6c9d tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a310f36f74e4eaabd9f32220feb274a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d1d41a90df4eb8ae7b9a3934629614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:39:41.177448 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-0ae6b52a-c79b-4bd0-9cbd-88d7ad8f6c9d tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] 10.222.0.45 "GET /compute/v2.1/servers/97a3e151-77b3-424a-9e0c-8fd838b8fe23" status: 200 len: 1314 microversion: 2.1 time: 1.741776 Aug 01 16:39:41.179464 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 13/27] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:39:39 2022] GET /compute/v2.1/servers/97a3e151-77b3-424a-9e0c-8fd838b8fe23 => generated 1314 bytes in 1745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:39:41.207110 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-2b99886b-7501-4df5-9f91-f97361f24a35 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1452566451", "imageRef": "c9cb5329-85cb-4472-935d-c4ea1d1f0592", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c367df93-8449-4ce9-84c8-05f8c630c096"}], "security_groups": [{"name": "tempest-securitygroup--1714615658"}], "key_name": "tempest-keypair-811461864", "user_data": "}} {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:39:41.920431 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.network.neutron [None req-2b99886b-7501-4df5-9f91-f97361f24a35 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] validate_networks() for [('c367df93-8449-4ce9-84c8-05f8c630c096', None, None, None, None, None)] {{(pid=118118) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 16:39:43.307381 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.virt.hardware [None req-c8baacff-8e17-4e0e-b767-eb5b34d04fa0 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Flavor limits 0:0:0 {{(pid=118117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 16:39:43.309278 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.virt.hardware [None req-c8baacff-8e17-4e0e-b767-eb5b34d04fa0 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Image limits 0:0:0 {{(pid=118117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 16:39:43.310083 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.virt.hardware [None req-c8baacff-8e17-4e0e-b767-eb5b34d04fa0 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Flavor pref 0:0:0 {{(pid=118117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 16:39:43.311570 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.virt.hardware [None req-c8baacff-8e17-4e0e-b767-eb5b34d04fa0 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Image pref 0:0:0 {{(pid=118117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 16:39:43.312307 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.virt.hardware [None req-c8baacff-8e17-4e0e-b767-eb5b34d04fa0 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 16:39:43.316111 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=9 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:43.332082 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-c8baacff-8e17-4e0e-b767-eb5b34d04fa0 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:43.333254 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-c8baacff-8e17-4e0e-b767-eb5b34d04fa0 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:43.334619 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-c8baacff-8e17-4e0e-b767-eb5b34d04fa0 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:43.335933 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-c8baacff-8e17-4e0e-b767-eb5b34d04fa0 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:43.347484 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_cell1:SELECT=23 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:43.364272 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.quota [None req-c8baacff-8e17-4e0e-b767-eb5b34d04fa0 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Getting quotas for project dbd6814591334db58a37092eb04729fb. Resources: {'cores', 'ram', 'instances'} {{(pid=118117) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 16:39:43.367564 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.virt.hardware [None req-2b99886b-7501-4df5-9f91-f97361f24a35 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Flavor limits 0:0:0 {{(pid=118118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 16:39:43.368181 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.virt.hardware [None req-2b99886b-7501-4df5-9f91-f97361f24a35 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Image limits 0:0:0 {{(pid=118118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 16:39:43.368487 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.virt.hardware [None req-2b99886b-7501-4df5-9f91-f97361f24a35 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Flavor pref 0:0:0 {{(pid=118118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 16:39:43.368937 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.virt.hardware [None req-2b99886b-7501-4df5-9f91-f97361f24a35 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Image pref 0:0:0 {{(pid=118118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 16:39:43.369379 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.virt.hardware [None req-2b99886b-7501-4df5-9f91-f97361f24a35 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 16:39:43.371277 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.quota [None req-c8baacff-8e17-4e0e-b767-eb5b34d04fa0 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Getting quotas for user 4294d6dff5054da7afcb37b8b28f1a01 and project dbd6814591334db58a37092eb04729fb. Resources: {'cores', 'ram', 'instances'} {{(pid=118117) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 16:39:43.386085 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-2b99886b-7501-4df5-9f91-f97361f24a35 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:43.386538 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-2b99886b-7501-4df5-9f91-f97361f24a35 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:43.387915 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-2b99886b-7501-4df5-9f91-f97361f24a35 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:43.389125 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-c8baacff-8e17-4e0e-b767-eb5b34d04fa0 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Going to run 1 instances... {{(pid=118117) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 16:39:43.389808 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-2b99886b-7501-4df5-9f91-f97361f24a35 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:43.391995 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-c8baacff-8e17-4e0e-b767-eb5b34d04fa0 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c9cb5329-85cb-4472-935d-c4ea1d1f0592',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118117) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 16:39:43.424851 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.quota [None req-2b99886b-7501-4df5-9f91-f97361f24a35 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Getting quotas for project 4c1c9729df694f46987e6dd30a09d5d2. Resources: {'cores', 'ram', 'instances'} {{(pid=118118) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 16:39:43.431892 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.quota [None req-2b99886b-7501-4df5-9f91-f97361f24a35 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Getting quotas for user 76c1fab92b854cd8937cc80818159191 and project 4c1c9729df694f46987e6dd30a09d5d2. Resources: {'cores', 'ram', 'instances'} {{(pid=118118) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 16:39:43.452722 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-2b99886b-7501-4df5-9f91-f97361f24a35 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Going to run 1 instances... {{(pid=118118) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 16:39:43.455496 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-2b99886b-7501-4df5-9f91-f97361f24a35 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c9cb5329-85cb-4472-935d-c4ea1d1f0592',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118118) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 16:39:43.487957 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-c8baacff-8e17-4e0e-b767-eb5b34d04fa0 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.539960 Aug 01 16:39:43.494486 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 15/28] 10.222.0.45 () {60 vars in 1147 bytes} [Mon Aug 1 16:39:39 2022] POST /compute/v2.1/servers => generated 383 bytes in 3542 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 01 16:39:43.511750 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-dedd5744-f18e-4118-a87c-e35110a52270 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:39:43.512405 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-dedd5744-f18e-4118-a87c-e35110a52270 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: a3f6b512-e3cb-4e87-8d82-c64f6f1640db] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:39:43.528850 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-dedd5744-f18e-4118-a87c-e35110a52270 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:43.529210 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-dedd5744-f18e-4118-a87c-e35110a52270 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:43.530001 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-dedd5744-f18e-4118-a87c-e35110a52270 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:43.530974 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-dedd5744-f18e-4118-a87c-e35110a52270 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:43.548878 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-2b99886b-7501-4df5-9f91-f97361f24a35 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.362745 Aug 01 16:39:43.549974 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 14/29] 10.222.0.45 () {62 vars in 1188 bytes} [Mon Aug 1 16:39:41 2022] POST /compute/v2.1/servers => generated 402 bytes in 2370 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 01 16:39:43.561131 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-c981404d-1fbd-46f2-9208-784ffaa62d7f tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:39:43.566227 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-c981404d-1fbd-46f2-9208-784ffaa62d7f tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] [instance: 97a3e151-77b3-424a-9e0c-8fd838b8fe23] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:39:43.577230 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-c981404d-1fbd-46f2-9208-784ffaa62d7f tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:43.578723 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-c981404d-1fbd-46f2-9208-784ffaa62d7f tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:43.580328 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-c981404d-1fbd-46f2-9208-784ffaa62d7f tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:43.580978 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-c981404d-1fbd-46f2-9208-784ffaa62d7f tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:43.741850 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-dedd5744-f18e-4118-a87c-e35110a52270 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0aed0278344119aae6906f4f52b1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b66d46c3e7d42b88f2dbdc01232fb03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:39:43.759714 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-dedd5744-f18e-4118-a87c-e35110a52270 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db" status: 200 len: 1294 microversion: 2.1 time: 0.268777 Aug 01 16:39:43.761691 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 16/30] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:39:43 2022] GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db => generated 1294 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:39:43.784803 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-ff55d7d8-c584-4ef6-b8a7-eacdc26a2b65 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:39:43.792465 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-ff55d7d8-c584-4ef6-b8a7-eacdc26a2b65 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:39:44.190308 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-ff55d7d8-c584-4ef6-b8a7-eacdc26a2b65 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:39:44.203068 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-ff55d7d8-c584-4ef6-b8a7-eacdc26a2b65 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7" status: 200 len: 1222 microversion: 2.1 time: 0.437706 Aug 01 16:39:44.205633 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 17/31] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:39:43 2022] GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7 => generated 1222 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:39:44.227056 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-e0682f83-80b1-4d1c-bdaa-ae3d326fbd6b tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:39:44.228450 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-e0682f83-80b1-4d1c-bdaa-ae3d326fbd6b tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:39:44.621842 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-e0682f83-80b1-4d1c-bdaa-ae3d326fbd6b tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:39:44.651846 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-e0682f83-80b1-4d1c-bdaa-ae3d326fbd6b tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:39:44.655954 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-e0682f83-80b1-4d1c-bdaa-ae3d326fbd6b tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:39:44.660029 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-e0682f83-80b1-4d1c-bdaa-ae3d326fbd6b tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1281 microversion: 2.20 time: 0.448709 Aug 01 16:39:44.680341 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 18/32] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:39:44 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1281 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:39:44.710424 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-c981404d-1fbd-46f2-9208-784ffaa62d7f tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a310f36f74e4eaabd9f32220feb274a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d1d41a90df4eb8ae7b9a3934629614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:39:44.729597 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_cell1:SELECT=43 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:44.749162 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-c981404d-1fbd-46f2-9208-784ffaa62d7f tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] 10.222.0.45 "GET /compute/v2.1/servers/97a3e151-77b3-424a-9e0c-8fd838b8fe23" status: 200 len: 1314 microversion: 2.1 time: 1.191837 Aug 01 16:39:44.752182 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 15/33] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:39:43 2022] GET /compute/v2.1/servers/97a3e151-77b3-424a-9e0c-8fd838b8fe23 => generated 1314 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:39:44.796017 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-77517fc2-a22b-43d7-b7ed-67a05ada8082 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:39:44.796652 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-77517fc2-a22b-43d7-b7ed-67a05ada8082 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: a3f6b512-e3cb-4e87-8d82-c64f6f1640db] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:39:44.815413 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-77517fc2-a22b-43d7-b7ed-67a05ada8082 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:44.816905 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-77517fc2-a22b-43d7-b7ed-67a05ada8082 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:44.818157 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-77517fc2-a22b-43d7-b7ed-67a05ada8082 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:44.819823 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-77517fc2-a22b-43d7-b7ed-67a05ada8082 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:44.994488 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-77517fc2-a22b-43d7-b7ed-67a05ada8082 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0aed0278344119aae6906f4f52b1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b66d46c3e7d42b88f2dbdc01232fb03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:39:45.011959 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-77517fc2-a22b-43d7-b7ed-67a05ada8082 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db" status: 200 len: 1294 microversion: 2.1 time: 0.220174 Aug 01 16:39:45.014530 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 19/34] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:39:44 2022] GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db => generated 1294 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:39:45.252923 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-a8e8ff40-fde3-438d-a515-348c193edba3 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:39:45.253477 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-a8e8ff40-fde3-438d-a515-348c193edba3 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:39:45.256542 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=6 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:45.270854 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a8e8ff40-fde3-438d-a515-348c193edba3 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:45.276489 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a8e8ff40-fde3-438d-a515-348c193edba3 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:45.277418 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a8e8ff40-fde3-438d-a515-348c193edba3 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:45.277878 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a8e8ff40-fde3-438d-a515-348c193edba3 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:45.396904 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-a8e8ff40-fde3-438d-a515-348c193edba3 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:39:45.404564 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-a8e8ff40-fde3-438d-a515-348c193edba3 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7" status: 200 len: 1226 microversion: 2.1 time: 0.155772 Aug 01 16:39:45.405813 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 16/35] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:39:45 2022] GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7 => generated 1226 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:39:45.556426 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-01016a85-0087-4c21-a7e5-261e5c871148 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1673949634", "imageRef": "c9cb5329-85cb-4472-935d-c4ea1d1f0592", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "94e169bb-9307-4057-852a-5a9a3345875b"}], "security_groups": [{"name": "tempest-securitygroup--2101652462"}], "key_name": "tempest-keypair-282676080", "user_data": "}} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:39:45.694655 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-0a4663ff-ff8b-4752-9d84-5402eb2e1535 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:39:45.695713 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-0a4663ff-ff8b-4752-9d84-5402eb2e1535 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:39:45.723205 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-0a4663ff-ff8b-4752-9d84-5402eb2e1535 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:45.725200 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-0a4663ff-ff8b-4752-9d84-5402eb2e1535 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:45.725200 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-0a4663ff-ff8b-4752-9d84-5402eb2e1535 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:45.725891 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-0a4663ff-ff8b-4752-9d84-5402eb2e1535 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:45.788723 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.network.neutron [None req-01016a85-0087-4c21-a7e5-261e5c871148 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] validate_networks() for [('94e169bb-9307-4057-852a-5a9a3345875b', None, None, None, None, None)] {{(pid=118117) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 16:39:45.920485 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-0a4663ff-ff8b-4752-9d84-5402eb2e1535 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:39:45.931794 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-0a4663ff-ff8b-4752-9d84-5402eb2e1535 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:39:45.933678 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-0a4663ff-ff8b-4752-9d84-5402eb2e1535 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:39:45.934837 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-0a4663ff-ff8b-4752-9d84-5402eb2e1535 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1285 microversion: 2.20 time: 0.250934 Aug 01 16:39:45.935738 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 17/36] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:39:45 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1285 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:39:45.942287 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-384351a6-0800-457b-8144-31e6a4aa13de tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:39:45.942909 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-384351a6-0800-457b-8144-31e6a4aa13de tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] [instance: 97a3e151-77b3-424a-9e0c-8fd838b8fe23] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:39:45.957111 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-384351a6-0800-457b-8144-31e6a4aa13de tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:45.957665 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-384351a6-0800-457b-8144-31e6a4aa13de tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:45.958945 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-384351a6-0800-457b-8144-31e6a4aa13de tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:45.959355 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-384351a6-0800-457b-8144-31e6a4aa13de tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:46.244188 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-384351a6-0800-457b-8144-31e6a4aa13de tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a310f36f74e4eaabd9f32220feb274a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d1d41a90df4eb8ae7b9a3934629614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:39:46.256623 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-384351a6-0800-457b-8144-31e6a4aa13de tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] 10.222.0.45 "GET /compute/v2.1/servers/97a3e151-77b3-424a-9e0c-8fd838b8fe23" status: 200 len: 1314 microversion: 2.1 time: 0.319611 Aug 01 16:39:46.257739 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 18/37] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:39:45 2022] GET /compute/v2.1/servers/97a3e151-77b3-424a-9e0c-8fd838b8fe23 => generated 1314 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:39:46.266319 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-f38eb218-5c50-4436-b11c-144a50599134 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:39:46.267310 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-f38eb218-5c50-4436-b11c-144a50599134 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: a3f6b512-e3cb-4e87-8d82-c64f6f1640db] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:39:46.287398 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-f38eb218-5c50-4436-b11c-144a50599134 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:46.287889 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-f38eb218-5c50-4436-b11c-144a50599134 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:46.288734 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-f38eb218-5c50-4436-b11c-144a50599134 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:46.290153 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-f38eb218-5c50-4436-b11c-144a50599134 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:46.380870 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-f38eb218-5c50-4436-b11c-144a50599134 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0aed0278344119aae6906f4f52b1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b66d46c3e7d42b88f2dbdc01232fb03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:39:46.400304 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-f38eb218-5c50-4436-b11c-144a50599134 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db" status: 200 len: 1294 microversion: 2.1 time: 0.140994 Aug 01 16:39:46.402684 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 19/38] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:39:46 2022] GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db => generated 1294 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:39:46.450235 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-90482823-b8eb-4e1e-b900-461cb6e39012 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:39:46.451156 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-90482823-b8eb-4e1e-b900-461cb6e39012 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:39:46.458955 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-90482823-b8eb-4e1e-b900-461cb6e39012 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:46.459606 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-90482823-b8eb-4e1e-b900-461cb6e39012 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:46.461156 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-90482823-b8eb-4e1e-b900-461cb6e39012 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:46.461752 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-90482823-b8eb-4e1e-b900-461cb6e39012 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:46.538996 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-90482823-b8eb-4e1e-b900-461cb6e39012 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:39:46.564488 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-90482823-b8eb-4e1e-b900-461cb6e39012 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7" status: 200 len: 1226 microversion: 2.1 time: 0.118548 Aug 01 16:39:46.565561 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 20/39] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:39:46 2022] GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7 => generated 1226 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:39:46.584394 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.virt.hardware [None req-01016a85-0087-4c21-a7e5-261e5c871148 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Flavor limits 0:0:0 {{(pid=118117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 16:39:46.585536 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.virt.hardware [None req-01016a85-0087-4c21-a7e5-261e5c871148 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Image limits 0:0:0 {{(pid=118117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 16:39:46.586630 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.virt.hardware [None req-01016a85-0087-4c21-a7e5-261e5c871148 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Flavor pref 0:0:0 {{(pid=118117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 16:39:46.587572 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.virt.hardware [None req-01016a85-0087-4c21-a7e5-261e5c871148 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Image pref 0:0:0 {{(pid=118117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 16:39:46.588775 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.virt.hardware [None req-01016a85-0087-4c21-a7e5-261e5c871148 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 16:39:46.605929 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-01016a85-0087-4c21-a7e5-261e5c871148 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:46.606740 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-01016a85-0087-4c21-a7e5-261e5c871148 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:46.608339 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-01016a85-0087-4c21-a7e5-261e5c871148 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:46.609143 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-01016a85-0087-4c21-a7e5-261e5c871148 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:46.644524 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.quota [None req-01016a85-0087-4c21-a7e5-261e5c871148 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Getting quotas for project 2f46e472f8614c5e847ceb225cc9bff1. Resources: {'cores', 'ram', 'instances'} {{(pid=118117) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 16:39:46.652440 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.quota [None req-01016a85-0087-4c21-a7e5-261e5c871148 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Getting quotas for user 1ac7d3acf1204a9f98f9ee14c2b46a5e and project 2f46e472f8614c5e847ceb225cc9bff1. Resources: {'cores', 'ram', 'instances'} {{(pid=118117) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 16:39:46.674795 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-01016a85-0087-4c21-a7e5-261e5c871148 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Going to run 1 instances... {{(pid=118117) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 16:39:46.679206 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-01016a85-0087-4c21-a7e5-261e5c871148 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 430702ec-add7-4d23-a875-36d09e281f0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c9cb5329-85cb-4472-935d-c4ea1d1f0592',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118117) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 16:39:46.775199 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-01016a85-0087-4c21-a7e5-261e5c871148 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.227254 Aug 01 16:39:46.776747 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 20/40] 10.222.0.45 () {60 vars in 1147 bytes} [Mon Aug 1 16:39:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 1230 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 16:39:46.792482 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-a2299170-2450-4ce1-905f-dfc5da86d94d tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:39:46.793603 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-a2299170-2450-4ce1-905f-dfc5da86d94d tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 430702ec-add7-4d23-a875-36d09e281f0a] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:39:46.911450 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-a2299170-2450-4ce1-905f-dfc5da86d94d tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac7d3acf1204a9f98f9ee14c2b46a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f46e472f8614c5e847ceb225cc9bff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:39:46.925607 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-a2299170-2450-4ce1-905f-dfc5da86d94d tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a" status: 200 len: 1241 microversion: 2.1 time: 0.140939 Aug 01 16:39:46.928298 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 21/41] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:39:46 2022] GET /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a => generated 1241 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:39:46.961533 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-2d27f1d8-6ab3-4e64-8823-89007aa85496 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:39:46.962336 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-2d27f1d8-6ab3-4e64-8823-89007aa85496 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:39:46.991824 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-2d27f1d8-6ab3-4e64-8823-89007aa85496 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:46.996402 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-2d27f1d8-6ab3-4e64-8823-89007aa85496 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:46.997844 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-2d27f1d8-6ab3-4e64-8823-89007aa85496 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:47.018628 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-2d27f1d8-6ab3-4e64-8823-89007aa85496 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:47.280577 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-2d27f1d8-6ab3-4e64-8823-89007aa85496 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:39:47.301367 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-66c66831-2d0e-4453-a501-c9201d1f9dc4 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:39:47.303652 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-66c66831-2d0e-4453-a501-c9201d1f9dc4 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] [instance: 97a3e151-77b3-424a-9e0c-8fd838b8fe23] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:39:47.325608 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-2d27f1d8-6ab3-4e64-8823-89007aa85496 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:39:47.334216 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-66c66831-2d0e-4453-a501-c9201d1f9dc4 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:47.335030 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-2d27f1d8-6ab3-4e64-8823-89007aa85496 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:39:47.336004 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-66c66831-2d0e-4453-a501-c9201d1f9dc4 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:47.339624 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-66c66831-2d0e-4453-a501-c9201d1f9dc4 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:47.341327 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-2d27f1d8-6ab3-4e64-8823-89007aa85496 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1285 microversion: 2.20 time: 0.385333 Aug 01 16:39:47.342398 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-66c66831-2d0e-4453-a501-c9201d1f9dc4 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:47.345305 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 21/42] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:39:46 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1285 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:39:47.427124 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-f490fdd3-a919-4668-afb0-b7278b4ca3da tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:39:47.435696 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-f490fdd3-a919-4668-afb0-b7278b4ca3da tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: a3f6b512-e3cb-4e87-8d82-c64f6f1640db] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:39:47.472080 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-f490fdd3-a919-4668-afb0-b7278b4ca3da tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:47.476244 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-f490fdd3-a919-4668-afb0-b7278b4ca3da tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:47.478144 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-f490fdd3-a919-4668-afb0-b7278b4ca3da tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:47.478932 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-f490fdd3-a919-4668-afb0-b7278b4ca3da tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:47.630807 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-66c66831-2d0e-4453-a501-c9201d1f9dc4 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a310f36f74e4eaabd9f32220feb274a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d1d41a90df4eb8ae7b9a3934629614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:39:47.641616 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-66c66831-2d0e-4453-a501-c9201d1f9dc4 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] 10.222.0.45 "GET /compute/v2.1/servers/97a3e151-77b3-424a-9e0c-8fd838b8fe23" status: 200 len: 1314 microversion: 2.1 time: 0.348280 Aug 01 16:39:47.658582 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 22/43] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:39:47 2022] GET /compute/v2.1/servers/97a3e151-77b3-424a-9e0c-8fd838b8fe23 => generated 1314 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:39:47.681733 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-4c64b2fe-755f-45a3-ba47-78c110f9adcc tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:39:47.683298 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-4c64b2fe-755f-45a3-ba47-78c110f9adcc tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:39:47.690759 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-4c64b2fe-755f-45a3-ba47-78c110f9adcc tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:47.691437 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-4c64b2fe-755f-45a3-ba47-78c110f9adcc tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:47.692509 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-4c64b2fe-755f-45a3-ba47-78c110f9adcc tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:47.693375 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-4c64b2fe-755f-45a3-ba47-78c110f9adcc tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:47.769875 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-f490fdd3-a919-4668-afb0-b7278b4ca3da tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0aed0278344119aae6906f4f52b1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b66d46c3e7d42b88f2dbdc01232fb03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:39:47.794796 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-f490fdd3-a919-4668-afb0-b7278b4ca3da tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db" status: 200 len: 1294 microversion: 2.1 time: 0.374834 Aug 01 16:39:47.815225 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 22/44] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:39:47 2022] GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db => generated 1294 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:39:47.840314 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-4c64b2fe-755f-45a3-ba47-78c110f9adcc tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:39:47.861027 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-4c64b2fe-755f-45a3-ba47-78c110f9adcc tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7" status: 200 len: 1218 microversion: 2.1 time: 0.198572 Aug 01 16:39:47.861618 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 23/45] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:39:47 2022] GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7 => generated 1218 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:39:47.981945 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-89a42eb4-0f09-48a3-a549-34fadea70cb1 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:39:47.985110 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-89a42eb4-0f09-48a3-a549-34fadea70cb1 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 430702ec-add7-4d23-a875-36d09e281f0a] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:39:48.162348 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-89a42eb4-0f09-48a3-a549-34fadea70cb1 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac7d3acf1204a9f98f9ee14c2b46a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f46e472f8614c5e847ceb225cc9bff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:39:48.173807 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-89a42eb4-0f09-48a3-a549-34fadea70cb1 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a" status: 200 len: 1241 microversion: 2.1 time: 0.210524 Aug 01 16:39:48.174497 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 23/46] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:39:47 2022] GET /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a => generated 1241 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:39:48.378257 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-093e22ea-8167-4cf5-aa0b-ad0b331db04d tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:39:48.378889 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-093e22ea-8167-4cf5-aa0b-ad0b331db04d tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:39:48.390411 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-093e22ea-8167-4cf5-aa0b-ad0b331db04d tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:48.390875 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-093e22ea-8167-4cf5-aa0b-ad0b331db04d tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:48.391633 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-093e22ea-8167-4cf5-aa0b-ad0b331db04d tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:48.392127 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-093e22ea-8167-4cf5-aa0b-ad0b331db04d tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:48.528068 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-093e22ea-8167-4cf5-aa0b-ad0b331db04d tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:39:48.541383 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-093e22ea-8167-4cf5-aa0b-ad0b331db04d tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:39:48.543467 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-093e22ea-8167-4cf5-aa0b-ad0b331db04d tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:39:48.544956 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-093e22ea-8167-4cf5-aa0b-ad0b331db04d tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1277 microversion: 2.20 time: 0.171199 Aug 01 16:39:48.548272 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 24/47] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:39:48 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1277 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:39:48.670356 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-1df438cd-0c17-418b-aa59-0ee93d7c57aa tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:39:48.671317 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-1df438cd-0c17-418b-aa59-0ee93d7c57aa tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] [instance: 97a3e151-77b3-424a-9e0c-8fd838b8fe23] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:39:48.681736 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-1df438cd-0c17-418b-aa59-0ee93d7c57aa tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:48.682335 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-1df438cd-0c17-418b-aa59-0ee93d7c57aa tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:48.683686 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-1df438cd-0c17-418b-aa59-0ee93d7c57aa tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:48.684994 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-1df438cd-0c17-418b-aa59-0ee93d7c57aa tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:48.823457 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-b9f6b22e-1a5d-497d-b039-71838206e739 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:39:48.824354 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-b9f6b22e-1a5d-497d-b039-71838206e739 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: a3f6b512-e3cb-4e87-8d82-c64f6f1640db] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:39:48.833802 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-b9f6b22e-1a5d-497d-b039-71838206e739 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:48.834960 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-b9f6b22e-1a5d-497d-b039-71838206e739 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:48.836205 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-b9f6b22e-1a5d-497d-b039-71838206e739 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:48.836747 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-b9f6b22e-1a5d-497d-b039-71838206e739 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:48.858888 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-1df438cd-0c17-418b-aa59-0ee93d7c57aa tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a310f36f74e4eaabd9f32220feb274a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d1d41a90df4eb8ae7b9a3934629614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:39:48.868275 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-1df438cd-0c17-418b-aa59-0ee93d7c57aa tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] 10.222.0.45 "GET /compute/v2.1/servers/97a3e151-77b3-424a-9e0c-8fd838b8fe23" status: 200 len: 1314 microversion: 2.1 time: 0.204857 Aug 01 16:39:48.869060 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 24/48] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:39:48 2022] GET /compute/v2.1/servers/97a3e151-77b3-424a-9e0c-8fd838b8fe23 => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:39:48.906282 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-cdbd6e91-5d15-4487-bb88-0af64f7f5c81 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:39:48.907376 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-cdbd6e91-5d15-4487-bb88-0af64f7f5c81 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:39:48.920859 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-cdbd6e91-5d15-4487-bb88-0af64f7f5c81 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:48.921654 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-cdbd6e91-5d15-4487-bb88-0af64f7f5c81 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:48.923250 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-cdbd6e91-5d15-4487-bb88-0af64f7f5c81 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:48.924226 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-cdbd6e91-5d15-4487-bb88-0af64f7f5c81 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:48.934691 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-b9f6b22e-1a5d-497d-b039-71838206e739 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0aed0278344119aae6906f4f52b1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b66d46c3e7d42b88f2dbdc01232fb03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:39:48.945243 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-b9f6b22e-1a5d-497d-b039-71838206e739 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db" status: 200 len: 1294 microversion: 2.1 time: 0.126853 Aug 01 16:39:48.946228 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 25/49] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:39:48 2022] GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db => generated 1294 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:39:49.015472 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-cdbd6e91-5d15-4487-bb88-0af64f7f5c81 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:39:49.032147 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-cdbd6e91-5d15-4487-bb88-0af64f7f5c81 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7" status: 200 len: 1218 microversion: 2.1 time: 0.133269 Aug 01 16:39:49.033253 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 25/50] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:39:48 2022] GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7 => generated 1218 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:39:49.208971 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-c6fb4863-3ae7-418e-8c8c-dda71ea88e8a tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:39:49.209613 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-c6fb4863-3ae7-418e-8c8c-dda71ea88e8a tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 430702ec-add7-4d23-a875-36d09e281f0a] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:39:49.216376 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-c6fb4863-3ae7-418e-8c8c-dda71ea88e8a tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:49.216855 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-c6fb4863-3ae7-418e-8c8c-dda71ea88e8a tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:49.217618 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-c6fb4863-3ae7-418e-8c8c-dda71ea88e8a tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:49.218068 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-c6fb4863-3ae7-418e-8c8c-dda71ea88e8a tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:49.285574 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-c6fb4863-3ae7-418e-8c8c-dda71ea88e8a tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac7d3acf1204a9f98f9ee14c2b46a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f46e472f8614c5e847ceb225cc9bff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:39:49.294317 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-c6fb4863-3ae7-418e-8c8c-dda71ea88e8a tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a" status: 200 len: 1245 microversion: 2.1 time: 0.089402 Aug 01 16:39:49.294915 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 26/51] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:39:49 2022] GET /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a => generated 1245 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:39:49.578829 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-b223023a-11c5-44f2-93b8-3133a75ab714 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:39:49.579862 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-b223023a-11c5-44f2-93b8-3133a75ab714 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:39:49.590037 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-b223023a-11c5-44f2-93b8-3133a75ab714 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:49.590742 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-b223023a-11c5-44f2-93b8-3133a75ab714 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:49.592036 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-b223023a-11c5-44f2-93b8-3133a75ab714 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:49.592731 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-b223023a-11c5-44f2-93b8-3133a75ab714 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:49.672722 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-b223023a-11c5-44f2-93b8-3133a75ab714 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:39:49.683867 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-b223023a-11c5-44f2-93b8-3133a75ab714 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:39:49.685735 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-b223023a-11c5-44f2-93b8-3133a75ab714 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:39:49.686955 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-b223023a-11c5-44f2-93b8-3133a75ab714 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1277 microversion: 2.20 time: 0.114480 Aug 01 16:39:49.687609 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 26/52] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:39:49 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1277 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:39:49.897325 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-02835bb9-0925-45e8-9310-33a571c2bfd4 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:39:49.897954 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-02835bb9-0925-45e8-9310-33a571c2bfd4 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] [instance: 97a3e151-77b3-424a-9e0c-8fd838b8fe23] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:39:49.905093 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-02835bb9-0925-45e8-9310-33a571c2bfd4 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:49.905518 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-02835bb9-0925-45e8-9310-33a571c2bfd4 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:49.906295 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-02835bb9-0925-45e8-9310-33a571c2bfd4 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:49.906725 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-02835bb9-0925-45e8-9310-33a571c2bfd4 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:49.980949 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-59c024f7-43c8-4795-b30f-fa20538a11bc tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:39:49.981890 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-59c024f7-43c8-4795-b30f-fa20538a11bc tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: a3f6b512-e3cb-4e87-8d82-c64f6f1640db] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:39:49.992402 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-59c024f7-43c8-4795-b30f-fa20538a11bc tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:49.993153 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-59c024f7-43c8-4795-b30f-fa20538a11bc tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:49.994489 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-59c024f7-43c8-4795-b30f-fa20538a11bc tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:49.995487 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-59c024f7-43c8-4795-b30f-fa20538a11bc tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:50.119249 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-59c024f7-43c8-4795-b30f-fa20538a11bc tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0aed0278344119aae6906f4f52b1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b66d46c3e7d42b88f2dbdc01232fb03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:39:50.132897 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-59c024f7-43c8-4795-b30f-fa20538a11bc tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db" status: 200 len: 1294 microversion: 2.1 time: 0.156900 Aug 01 16:39:50.134563 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 27/53] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:39:49 2022] GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db => generated 1294 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:39:50.143053 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-7bbd8204-7441-47f7-8f27-a98400104c4a tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:39:50.144213 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-7bbd8204-7441-47f7-8f27-a98400104c4a tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:39:50.148073 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-02835bb9-0925-45e8-9310-33a571c2bfd4 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a310f36f74e4eaabd9f32220feb274a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d1d41a90df4eb8ae7b9a3934629614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:39:50.153748 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-7bbd8204-7441-47f7-8f27-a98400104c4a tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:50.154456 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-7bbd8204-7441-47f7-8f27-a98400104c4a tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:50.155445 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-7bbd8204-7441-47f7-8f27-a98400104c4a tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:50.156106 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-7bbd8204-7441-47f7-8f27-a98400104c4a tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:50.173849 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-02835bb9-0925-45e8-9310-33a571c2bfd4 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] 10.222.0.45 "GET /compute/v2.1/servers/97a3e151-77b3-424a-9e0c-8fd838b8fe23" status: 200 len: 1314 microversion: 2.1 time: 0.280216 Aug 01 16:39:50.175213 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 27/54] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:39:49 2022] GET /compute/v2.1/servers/97a3e151-77b3-424a-9e0c-8fd838b8fe23 => generated 1314 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:39:50.250783 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-7bbd8204-7441-47f7-8f27-a98400104c4a tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:39:50.262796 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-7bbd8204-7441-47f7-8f27-a98400104c4a tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7" status: 200 len: 1218 microversion: 2.1 time: 0.126347 Aug 01 16:39:50.264150 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 28/55] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:39:50 2022] GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7 => generated 1218 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:39:50.322644 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-abff852e-94cd-43de-82fd-efb9c7175744 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:39:50.323337 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-abff852e-94cd-43de-82fd-efb9c7175744 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 430702ec-add7-4d23-a875-36d09e281f0a] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:39:50.339273 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-abff852e-94cd-43de-82fd-efb9c7175744 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:50.339874 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-abff852e-94cd-43de-82fd-efb9c7175744 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:50.340735 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-abff852e-94cd-43de-82fd-efb9c7175744 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:50.341320 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-abff852e-94cd-43de-82fd-efb9c7175744 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:50.433380 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-abff852e-94cd-43de-82fd-efb9c7175744 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac7d3acf1204a9f98f9ee14c2b46a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f46e472f8614c5e847ceb225cc9bff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:39:50.441686 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-abff852e-94cd-43de-82fd-efb9c7175744 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a" status: 200 len: 1245 microversion: 2.1 time: 0.124344 Aug 01 16:39:50.442646 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 28/56] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:39:50 2022] GET /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a => generated 1245 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:39:50.711993 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-5a71f538-812e-45a7-9daa-35b5b704a424 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:39:50.713216 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-5a71f538-812e-45a7-9daa-35b5b704a424 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:39:50.725271 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-5a71f538-812e-45a7-9daa-35b5b704a424 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:50.726084 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-5a71f538-812e-45a7-9daa-35b5b704a424 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:50.727424 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-5a71f538-812e-45a7-9daa-35b5b704a424 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:50.728568 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-5a71f538-812e-45a7-9daa-35b5b704a424 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:51.117054 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-5a71f538-812e-45a7-9daa-35b5b704a424 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:39:51.159526 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-5a71f538-812e-45a7-9daa-35b5b704a424 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:39:51.187112 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-5a71f538-812e-45a7-9daa-35b5b704a424 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:39:51.188969 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-215063dd-5198-48a8-aac1-147ed1a84631 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:39:51.196820 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-215063dd-5198-48a8-aac1-147ed1a84631 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: a3f6b512-e3cb-4e87-8d82-c64f6f1640db] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:39:51.210419 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-5a71f538-812e-45a7-9daa-35b5b704a424 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1277 microversion: 2.20 time: 0.501232 Aug 01 16:39:51.221070 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 29/57] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:39:50 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1277 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:39:51.232759 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-215063dd-5198-48a8-aac1-147ed1a84631 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:51.233803 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-215063dd-5198-48a8-aac1-147ed1a84631 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:51.235560 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-215063dd-5198-48a8-aac1-147ed1a84631 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:51.261907 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-215063dd-5198-48a8-aac1-147ed1a84631 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:51.262589 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-fc85052b-cedd-4160-85de-70a6eb4ec924 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:39:51.279799 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-fc85052b-cedd-4160-85de-70a6eb4ec924 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] [instance: 97a3e151-77b3-424a-9e0c-8fd838b8fe23] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:39:51.296880 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-fc85052b-cedd-4160-85de-70a6eb4ec924 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:51.299658 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-fc85052b-cedd-4160-85de-70a6eb4ec924 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:51.305611 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-fc85052b-cedd-4160-85de-70a6eb4ec924 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:51.306418 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-fc85052b-cedd-4160-85de-70a6eb4ec924 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:51.654641 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-215063dd-5198-48a8-aac1-147ed1a84631 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0aed0278344119aae6906f4f52b1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b66d46c3e7d42b88f2dbdc01232fb03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:39:51.664530 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-215063dd-5198-48a8-aac1-147ed1a84631 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db" status: 200 len: 1294 microversion: 2.1 time: 0.495828 Aug 01 16:39:51.665453 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 29/58] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:39:51 2022] GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db => generated 1294 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:39:51.687669 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-3cf370ed-eb9a-418b-9bf7-5d7edb080e6c tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:39:51.688163 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-3cf370ed-eb9a-418b-9bf7-5d7edb080e6c tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:39:51.698179 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3cf370ed-eb9a-418b-9bf7-5d7edb080e6c tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:51.699009 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3cf370ed-eb9a-418b-9bf7-5d7edb080e6c tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:51.699485 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3cf370ed-eb9a-418b-9bf7-5d7edb080e6c tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:51.700319 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3cf370ed-eb9a-418b-9bf7-5d7edb080e6c tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:51.860596 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-3cf370ed-eb9a-418b-9bf7-5d7edb080e6c tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:39:51.871671 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-3cf370ed-eb9a-418b-9bf7-5d7edb080e6c tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7" status: 200 len: 1282 microversion: 2.1 time: 0.188389 Aug 01 16:39:51.872702 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 30/59] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:39:51 2022] GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7 => generated 1282 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:39:51.883808 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-31bbf2d6-90be-44ff-a733-687e58562211 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:39:51.883808 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-31bbf2d6-90be-44ff-a733-687e58562211 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 430702ec-add7-4d23-a875-36d09e281f0a] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:39:51.893510 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-31bbf2d6-90be-44ff-a733-687e58562211 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:51.894349 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-31bbf2d6-90be-44ff-a733-687e58562211 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:51.895557 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-31bbf2d6-90be-44ff-a733-687e58562211 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:51.897087 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-31bbf2d6-90be-44ff-a733-687e58562211 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:52.046118 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-fc85052b-cedd-4160-85de-70a6eb4ec924 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a310f36f74e4eaabd9f32220feb274a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d1d41a90df4eb8ae7b9a3934629614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:39:52.055159 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-fc85052b-cedd-4160-85de-70a6eb4ec924 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] 10.222.0.45 "GET /compute/v2.1/servers/97a3e151-77b3-424a-9e0c-8fd838b8fe23" status: 200 len: 1314 microversion: 2.1 time: 0.832216 Aug 01 16:39:52.055831 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 30/60] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:39:51 2022] GET /compute/v2.1/servers/97a3e151-77b3-424a-9e0c-8fd838b8fe23 => generated 1314 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:39:52.219459 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-31bbf2d6-90be-44ff-a733-687e58562211 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac7d3acf1204a9f98f9ee14c2b46a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f46e472f8614c5e847ceb225cc9bff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:39:52.231866 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-31bbf2d6-90be-44ff-a733-687e58562211 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a" status: 200 len: 1293 microversion: 2.1 time: 0.355975 Aug 01 16:39:52.244267 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 31/61] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:39:51 2022] GET /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a => generated 1293 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:39:52.266450 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-74ef4597-34b8-4c24-bdce-c4d700fe6197 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:39:52.268520 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-74ef4597-34b8-4c24-bdce-c4d700fe6197 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:39:52.284510 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-74ef4597-34b8-4c24-bdce-c4d700fe6197 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:52.285372 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-74ef4597-34b8-4c24-bdce-c4d700fe6197 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:52.289457 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-74ef4597-34b8-4c24-bdce-c4d700fe6197 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:52.298791 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-74ef4597-34b8-4c24-bdce-c4d700fe6197 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:52.536734 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-74ef4597-34b8-4c24-bdce-c4d700fe6197 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:39:52.549368 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-74ef4597-34b8-4c24-bdce-c4d700fe6197 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:39:52.555567 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-74ef4597-34b8-4c24-bdce-c4d700fe6197 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:39:52.557178 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-74ef4597-34b8-4c24-bdce-c4d700fe6197 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1341 microversion: 2.20 time: 0.298920 Aug 01 16:39:52.558178 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 31/62] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:39:52 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1341 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:39:52.571418 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [req-c75e3cdb-00ce-4326-b2ac-4964337fd4d0 req-e571f3f5-56cf-4687-998a-6c14dde3f7a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddf9be16-b3ce-411b-ac14-17dae5f41821", "tag": "896a3303-311c-4912-963a-aaa4ea080415"}]} {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:39:52.612366 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-c75e3cdb-00ce-4326-b2ac-4964337fd4d0 req-e571f3f5-56cf-4687-998a-6c14dde3f7a0 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:52.613465 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-c75e3cdb-00ce-4326-b2ac-4964337fd4d0 req-e571f3f5-56cf-4687-998a-6c14dde3f7a0 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:52.634868 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.compute.server_external_events [req-c75e3cdb-00ce-4326-b2ac-4964337fd4d0 req-e571f3f5-56cf-4687-998a-6c14dde3f7a0 service nova] Creating event network-changed:896a3303-311c-4912-963a-aaa4ea080415 for instance ddf9be16-b3ce-411b-ac14-17dae5f41821 on hv-cinder-85032 Aug 01 16:39:52.649212 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [req-c75e3cdb-00ce-4326-b2ac-4964337fd4d0 req-e571f3f5-56cf-4687-998a-6c14dde3f7a0 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082843 Aug 01 16:39:52.650487 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 32/63] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:39:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:39:52.699954 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-6acc45e5-be3c-4f16-a413-bdef6112c64a tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:39:52.700579 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-6acc45e5-be3c-4f16-a413-bdef6112c64a tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: a3f6b512-e3cb-4e87-8d82-c64f6f1640db] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:39:52.711179 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-6acc45e5-be3c-4f16-a413-bdef6112c64a tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:52.711500 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-6acc45e5-be3c-4f16-a413-bdef6112c64a tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:52.712325 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-6acc45e5-be3c-4f16-a413-bdef6112c64a tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:52.712766 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-6acc45e5-be3c-4f16-a413-bdef6112c64a tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:52.916565 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-4698dcac-d304-45f6-9335-fa3377f6b971 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:39:52.917311 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-4698dcac-d304-45f6-9335-fa3377f6b971 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:39:52.932796 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-4698dcac-d304-45f6-9335-fa3377f6b971 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:52.933257 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-4698dcac-d304-45f6-9335-fa3377f6b971 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:52.934682 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-4698dcac-d304-45f6-9335-fa3377f6b971 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:52.935157 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-4698dcac-d304-45f6-9335-fa3377f6b971 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:53.002192 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-6acc45e5-be3c-4f16-a413-bdef6112c64a tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0aed0278344119aae6906f4f52b1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b66d46c3e7d42b88f2dbdc01232fb03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:39:53.028688 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-6acc45e5-be3c-4f16-a413-bdef6112c64a tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db" status: 200 len: 1294 microversion: 2.1 time: 0.332463 Aug 01 16:39:53.031665 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 32/64] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:39:52 2022] GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db => generated 1294 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:39:53.078488 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-48ef6c02-68a5-4717-8865-73de712a0a4b tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:39:53.079405 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-48ef6c02-68a5-4717-8865-73de712a0a4b tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] [instance: 97a3e151-77b3-424a-9e0c-8fd838b8fe23] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:39:53.097351 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-48ef6c02-68a5-4717-8865-73de712a0a4b tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:53.098644 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-48ef6c02-68a5-4717-8865-73de712a0a4b tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:53.102853 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-48ef6c02-68a5-4717-8865-73de712a0a4b tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:53.104741 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-48ef6c02-68a5-4717-8865-73de712a0a4b tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:53.229380 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-4698dcac-d304-45f6-9335-fa3377f6b971 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:39:53.243470 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-4698dcac-d304-45f6-9335-fa3377f6b971 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7" status: 200 len: 1280 microversion: 2.1 time: 0.337066 Aug 01 16:39:53.247420 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 33/65] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:39:52 2022] GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7 => generated 1280 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:39:53.289975 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-b8267a9e-13c9-4e9d-b595-429c31f8299c tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:39:53.299623 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-b8267a9e-13c9-4e9d-b595-429c31f8299c tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 430702ec-add7-4d23-a875-36d09e281f0a] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:39:53.320746 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-b8267a9e-13c9-4e9d-b595-429c31f8299c tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:53.321189 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-b8267a9e-13c9-4e9d-b595-429c31f8299c tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:53.331988 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-b8267a9e-13c9-4e9d-b595-429c31f8299c tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:53.333021 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-b8267a9e-13c9-4e9d-b595-429c31f8299c tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:53.345986 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_cell1:SELECT=100 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:53.411788 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_cell0:SELECT=6 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:53.596809 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-b8267a9e-13c9-4e9d-b595-429c31f8299c tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac7d3acf1204a9f98f9ee14c2b46a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f46e472f8614c5e847ceb225cc9bff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:39:53.613742 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-b8267a9e-13c9-4e9d-b595-429c31f8299c tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a" status: 200 len: 1299 microversion: 2.1 time: 0.350259 Aug 01 16:39:53.627885 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 34/66] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:39:53 2022] GET /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a => generated 1299 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:39:53.655080 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-67ad9e2e-30bf-40e1-b3e8-13243805c1d2 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:39:53.658756 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-67ad9e2e-30bf-40e1-b3e8-13243805c1d2 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:39:53.685822 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-67ad9e2e-30bf-40e1-b3e8-13243805c1d2 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:53.686870 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-67ad9e2e-30bf-40e1-b3e8-13243805c1d2 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:53.689251 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-67ad9e2e-30bf-40e1-b3e8-13243805c1d2 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:53.690473 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-67ad9e2e-30bf-40e1-b3e8-13243805c1d2 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:53.853198 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-48ef6c02-68a5-4717-8865-73de712a0a4b tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a310f36f74e4eaabd9f32220feb274a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d1d41a90df4eb8ae7b9a3934629614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:39:53.870437 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-48ef6c02-68a5-4717-8865-73de712a0a4b tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] 10.222.0.45 "GET /compute/v2.1/servers/97a3e151-77b3-424a-9e0c-8fd838b8fe23" status: 200 len: 1314 microversion: 2.1 time: 0.796350 Aug 01 16:39:53.871780 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 33/67] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:39:53 2022] GET /compute/v2.1/servers/97a3e151-77b3-424a-9e0c-8fd838b8fe23 => generated 1314 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:39:54.044428 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-67ad9e2e-30bf-40e1-b3e8-13243805c1d2 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:39:54.053318 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-67ad9e2e-30bf-40e1-b3e8-13243805c1d2 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:39:54.054862 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-67ad9e2e-30bf-40e1-b3e8-13243805c1d2 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:39:54.056036 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-67ad9e2e-30bf-40e1-b3e8-13243805c1d2 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1339 microversion: 2.20 time: 0.425460 Aug 01 16:39:54.068133 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 35/68] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:39:53 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1339 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:39:54.086072 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-99e9894c-8e52-42d2-8bad-2209c9a58b5a tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:39:54.086072 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-99e9894c-8e52-42d2-8bad-2209c9a58b5a tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: a3f6b512-e3cb-4e87-8d82-c64f6f1640db] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:39:54.103260 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-99e9894c-8e52-42d2-8bad-2209c9a58b5a tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:54.104653 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-99e9894c-8e52-42d2-8bad-2209c9a58b5a tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:54.105492 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-99e9894c-8e52-42d2-8bad-2209c9a58b5a tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:54.105936 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-99e9894c-8e52-42d2-8bad-2209c9a58b5a tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:54.278840 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-6697c8a5-cf3f-4d64-892b-431ebd4e64fb tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:39:54.280012 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-6697c8a5-cf3f-4d64-892b-431ebd4e64fb tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:39:54.306778 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-6697c8a5-cf3f-4d64-892b-431ebd4e64fb tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:54.310276 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-6697c8a5-cf3f-4d64-892b-431ebd4e64fb tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:54.311981 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-6697c8a5-cf3f-4d64-892b-431ebd4e64fb tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:54.317431 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-6697c8a5-cf3f-4d64-892b-431ebd4e64fb tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:54.582923 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-6697c8a5-cf3f-4d64-892b-431ebd4e64fb tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:39:54.600789 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-6697c8a5-cf3f-4d64-892b-431ebd4e64fb tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7" status: 200 len: 1280 microversion: 2.1 time: 0.327534 Aug 01 16:39:54.619576 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 36/69] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:39:54 2022] GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7 => generated 1280 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:39:54.655564 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-2847fe32-2a82-4c53-8cc5-2ac95a14ea4d tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:39:54.656669 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-2847fe32-2a82-4c53-8cc5-2ac95a14ea4d tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 430702ec-add7-4d23-a875-36d09e281f0a] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:39:54.675244 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-2847fe32-2a82-4c53-8cc5-2ac95a14ea4d tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:54.677645 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-2847fe32-2a82-4c53-8cc5-2ac95a14ea4d tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:54.682486 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-2847fe32-2a82-4c53-8cc5-2ac95a14ea4d tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:54.683413 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-2847fe32-2a82-4c53-8cc5-2ac95a14ea4d tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:54.899288 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-2847fe32-2a82-4c53-8cc5-2ac95a14ea4d tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac7d3acf1204a9f98f9ee14c2b46a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f46e472f8614c5e847ceb225cc9bff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:39:54.922767 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-2847fe32-2a82-4c53-8cc5-2ac95a14ea4d tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a" status: 200 len: 1299 microversion: 2.1 time: 0.283999 Aug 01 16:39:54.923397 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 37/70] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:39:54 2022] GET /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a => generated 1299 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:39:54.928634 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-d5d71415-7f3c-49c6-9ad6-060265d2753d tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:39:54.933506 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-d5d71415-7f3c-49c6-9ad6-060265d2753d tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] [instance: 97a3e151-77b3-424a-9e0c-8fd838b8fe23] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:39:54.946639 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-d5d71415-7f3c-49c6-9ad6-060265d2753d tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:54.947576 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-d5d71415-7f3c-49c6-9ad6-060265d2753d tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:54.955900 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-d5d71415-7f3c-49c6-9ad6-060265d2753d tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:54.956796 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-d5d71415-7f3c-49c6-9ad6-060265d2753d tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:55.044586 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-99e9894c-8e52-42d2-8bad-2209c9a58b5a tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0aed0278344119aae6906f4f52b1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b66d46c3e7d42b88f2dbdc01232fb03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:39:55.070534 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-99e9894c-8e52-42d2-8bad-2209c9a58b5a tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db" status: 200 len: 1362 microversion: 2.1 time: 0.999313 Aug 01 16:39:55.082388 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 34/71] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:39:54 2022] GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db => generated 1362 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:39:55.122623 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-7d49dc9b-c090-45de-be08-8f6183d5c993 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:39:55.133065 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-7d49dc9b-c090-45de-be08-8f6183d5c993 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:39:55.177709 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-7d49dc9b-c090-45de-be08-8f6183d5c993 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:55.180501 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-7d49dc9b-c090-45de-be08-8f6183d5c993 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:55.181378 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-7d49dc9b-c090-45de-be08-8f6183d5c993 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:55.182142 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-7d49dc9b-c090-45de-be08-8f6183d5c993 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:55.759228 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-7d49dc9b-c090-45de-be08-8f6183d5c993 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:39:55.802449 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-7d49dc9b-c090-45de-be08-8f6183d5c993 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:39:55.805445 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-7d49dc9b-c090-45de-be08-8f6183d5c993 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:39:55.807731 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-7d49dc9b-c090-45de-be08-8f6183d5c993 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1339 microversion: 2.20 time: 0.720245 Aug 01 16:39:55.819988 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 35/72] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:39:55 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1339 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:39:56.344414 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [req-31efdc17-2d05-4f4e-95c7-8ae0e9a07aac req-f18f0c64-d3eb-429f-8af1-efeea5c2f749 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97a3e151-77b3-424a-9e0c-8fd838b8fe23", "name": "network-vif-plugged", "status": "completed", "tag": "8ab1f8c1-69bb-4671-98fe-5bb145658c82"}]} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:39:56.398119 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-31efdc17-2d05-4f4e-95c7-8ae0e9a07aac req-f18f0c64-d3eb-429f-8af1-efeea5c2f749 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:56.399458 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-31efdc17-2d05-4f4e-95c7-8ae0e9a07aac req-f18f0c64-d3eb-429f-8af1-efeea5c2f749 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:56.454369 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_cell1:SELECT=100 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:56.479514 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.compute.server_external_events [req-31efdc17-2d05-4f4e-95c7-8ae0e9a07aac req-f18f0c64-d3eb-429f-8af1-efeea5c2f749 service nova] Creating event network-vif-plugged:8ab1f8c1-69bb-4671-98fe-5bb145658c82 for instance 97a3e151-77b3-424a-9e0c-8fd838b8fe23 on hv-cinder-85032 Aug 01 16:39:56.485793 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-31efdc17-2d05-4f4e-95c7-8ae0e9a07aac req-f18f0c64-d3eb-429f-8af1-efeea5c2f749 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118117) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 01 16:39:56.497046 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-beac3da6-c802-4173-a4a7-1c27a752b146 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:56.501241 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-beac3da6-c802-4173-a4a7-1c27a752b146 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:56.508064 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-beac3da6-c802-4173-a4a7-1c27a752b146 None None] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:56.512904 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-beac3da6-c802-4173-a4a7-1c27a752b146 None None] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:56.573106 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_cell0:SELECT=7 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:56.585309 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.compute.rpcapi [None req-beac3da6-c802-4173-a4a7-1c27a752b146 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 01 16:39:56.587672 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-beac3da6-c802-4173-a4a7-1c27a752b146 None None] Releasing lock "compute-rpcapi-router" {{(pid=118117) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 01 16:39:56.661010 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-beac3da6-c802-4173-a4a7-1c27a752b146 None None] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.830730 Aug 01 16:39:56.669296 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 36/73] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:39:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:39:56.729127 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-9b50215a-616c-4a95-834c-12c9736731f7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:39:56.737625 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-9b50215a-616c-4a95-834c-12c9736731f7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:39:56.771116 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-9b50215a-616c-4a95-834c-12c9736731f7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:56.773541 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-9b50215a-616c-4a95-834c-12c9736731f7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:56.776377 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-9b50215a-616c-4a95-834c-12c9736731f7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:56.780074 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-9b50215a-616c-4a95-834c-12c9736731f7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:56.923576 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_cell0:SELECT=16 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:56.976048 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-d5d71415-7f3c-49c6-9ad6-060265d2753d tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a310f36f74e4eaabd9f32220feb274a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d1d41a90df4eb8ae7b9a3934629614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:39:57.016228 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-d5d71415-7f3c-49c6-9ad6-060265d2753d tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] 10.222.0.45 "GET /compute/v2.1/servers/97a3e151-77b3-424a-9e0c-8fd838b8fe23" status: 200 len: 1314 microversion: 2.1 time: 2.090080 Aug 01 16:39:57.033835 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 38/74] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:39:54 2022] GET /compute/v2.1/servers/97a3e151-77b3-424a-9e0c-8fd838b8fe23 => generated 1314 bytes in 2100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:39:57.059172 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-a093b8b9-690d-4b06-b6d0-15eb64ddc770 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:39:57.065987 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-a093b8b9-690d-4b06-b6d0-15eb64ddc770 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 430702ec-add7-4d23-a875-36d09e281f0a] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:39:57.092712 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a093b8b9-690d-4b06-b6d0-15eb64ddc770 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:57.093188 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a093b8b9-690d-4b06-b6d0-15eb64ddc770 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:57.096813 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a093b8b9-690d-4b06-b6d0-15eb64ddc770 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:57.097344 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a093b8b9-690d-4b06-b6d0-15eb64ddc770 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:57.340802 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-a093b8b9-690d-4b06-b6d0-15eb64ddc770 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac7d3acf1204a9f98f9ee14c2b46a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f46e472f8614c5e847ceb225cc9bff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:39:57.350371 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-a093b8b9-690d-4b06-b6d0-15eb64ddc770 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a" status: 200 len: 1299 microversion: 2.1 time: 0.313461 Aug 01 16:39:57.351072 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 39/75] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:39:57 2022] GET /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a => generated 1299 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:39:57.356722 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-619b71fa-f6b1-4063-a029-bd3b329685e1 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:39:57.357654 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-619b71fa-f6b1-4063-a029-bd3b329685e1 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: a3f6b512-e3cb-4e87-8d82-c64f6f1640db] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:39:57.364930 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-619b71fa-f6b1-4063-a029-bd3b329685e1 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:57.365573 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-619b71fa-f6b1-4063-a029-bd3b329685e1 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:57.366530 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-619b71fa-f6b1-4063-a029-bd3b329685e1 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:57.367205 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-619b71fa-f6b1-4063-a029-bd3b329685e1 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:57.483753 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-9b50215a-616c-4a95-834c-12c9736731f7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:39:57.507815 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-9b50215a-616c-4a95-834c-12c9736731f7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7" status: 200 len: 1322 microversion: 2.1 time: 0.833547 Aug 01 16:39:57.510097 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 37/76] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:39:56 2022] GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7 => generated 1322 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:39:57.525185 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-380f4a4c-6e25-4c3d-80b3-99541bf09000 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:39:57.525877 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-380f4a4c-6e25-4c3d-80b3-99541bf09000 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:39:57.536295 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-380f4a4c-6e25-4c3d-80b3-99541bf09000 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:57.537850 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-380f4a4c-6e25-4c3d-80b3-99541bf09000 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:57.538691 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-380f4a4c-6e25-4c3d-80b3-99541bf09000 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:57.539126 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-380f4a4c-6e25-4c3d-80b3-99541bf09000 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:58.136301 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-619b71fa-f6b1-4063-a029-bd3b329685e1 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0aed0278344119aae6906f4f52b1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b66d46c3e7d42b88f2dbdc01232fb03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:39:58.155684 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-619b71fa-f6b1-4063-a029-bd3b329685e1 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db" status: 200 len: 1362 microversion: 2.1 time: 0.802892 Aug 01 16:39:58.160980 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 40/77] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:39:57 2022] GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db => generated 1362 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:39:58.168124 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_cell0:SELECT=34 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:39:58.173611 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [req-66a2d074-fe5c-43e6-87ef-5d00c4c9468c req-a71688c0-32d0-4549-9789-970e1fba09a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7", "tag": "fe392c22-efae-48fa-84a5-56b4d266ae8b"}]} {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:39:58.213248 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-66a2d074-fe5c-43e6-87ef-5d00c4c9468c req-a71688c0-32d0-4549-9789-970e1fba09a6 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:58.213868 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-66a2d074-fe5c-43e6-87ef-5d00c4c9468c req-a71688c0-32d0-4549-9789-970e1fba09a6 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:58.237465 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.compute.server_external_events [req-66a2d074-fe5c-43e6-87ef-5d00c4c9468c req-a71688c0-32d0-4549-9789-970e1fba09a6 service nova] Creating event network-changed:fe392c22-efae-48fa-84a5-56b4d266ae8b for instance d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7 on hv-cinder-85032 Aug 01 16:39:58.262545 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [req-66a2d074-fe5c-43e6-87ef-5d00c4c9468c req-a71688c0-32d0-4549-9789-970e1fba09a6 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088480 Aug 01 16:39:58.265722 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 41/78] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:39:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:39:58.276005 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-66202843-668d-435d-a34e-868328b04037 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:39:58.278795 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-66202843-668d-435d-a34e-868328b04037 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] [instance: 97a3e151-77b3-424a-9e0c-8fd838b8fe23] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:39:58.296564 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-66202843-668d-435d-a34e-868328b04037 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:58.299297 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-66202843-668d-435d-a34e-868328b04037 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:58.300462 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-66202843-668d-435d-a34e-868328b04037 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:58.302957 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-66202843-668d-435d-a34e-868328b04037 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:58.311689 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-380f4a4c-6e25-4c3d-80b3-99541bf09000 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:39:58.348123 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-380f4a4c-6e25-4c3d-80b3-99541bf09000 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:39:58.361142 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-380f4a4c-6e25-4c3d-80b3-99541bf09000 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:39:58.369238 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-380f4a4c-6e25-4c3d-80b3-99541bf09000 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1407 microversion: 2.20 time: 0.856892 Aug 01 16:39:58.371428 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 38/79] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:39:57 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1407 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:39:58.711019 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-66202843-668d-435d-a34e-868328b04037 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a310f36f74e4eaabd9f32220feb274a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d1d41a90df4eb8ae7b9a3934629614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:39:58.723456 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-66202843-668d-435d-a34e-868328b04037 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] 10.222.0.45 "GET /compute/v2.1/servers/97a3e151-77b3-424a-9e0c-8fd838b8fe23" status: 200 len: 1314 microversion: 2.1 time: 0.454151 Aug 01 16:39:58.724374 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 42/80] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:39:58 2022] GET /compute/v2.1/servers/97a3e151-77b3-424a-9e0c-8fd838b8fe23 => generated 1314 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:39:58.743009 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-9bd3939c-b677-418c-97b7-80809a272c09 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:39:58.743667 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-9bd3939c-b677-418c-97b7-80809a272c09 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 430702ec-add7-4d23-a875-36d09e281f0a] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:39:58.752290 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-9bd3939c-b677-418c-97b7-80809a272c09 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:58.763250 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-9bd3939c-b677-418c-97b7-80809a272c09 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:58.765406 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-9bd3939c-b677-418c-97b7-80809a272c09 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:58.766767 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-9bd3939c-b677-418c-97b7-80809a272c09 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:58.776795 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [req-416cb1bc-b12c-4956-9c39-0ef2dc2553e1 req-915774b9-5f42-478d-ae27-cc4e4700ea14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3f6b512-e3cb-4e87-8d82-c64f6f1640db", "tag": "6a20ac6a-706d-492a-a5e3-62c35c931aa8"}]} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:39:58.797519 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-416cb1bc-b12c-4956-9c39-0ef2dc2553e1 req-915774b9-5f42-478d-ae27-cc4e4700ea14 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:58.798956 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-416cb1bc-b12c-4956-9c39-0ef2dc2553e1 req-915774b9-5f42-478d-ae27-cc4e4700ea14 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:58.861391 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.compute.server_external_events [req-416cb1bc-b12c-4956-9c39-0ef2dc2553e1 req-915774b9-5f42-478d-ae27-cc4e4700ea14 service nova] Creating event network-changed:6a20ac6a-706d-492a-a5e3-62c35c931aa8 for instance a3f6b512-e3cb-4e87-8d82-c64f6f1640db on hv-cinder-85032 Aug 01 16:39:58.890418 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [req-416cb1bc-b12c-4956-9c39-0ef2dc2553e1 req-915774b9-5f42-478d-ae27-cc4e4700ea14 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.516779 Aug 01 16:39:58.898422 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 39/81] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:39:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:39:58.920364 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-271de31b-e2db-406d-b683-64b87627c89f tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:39:58.922207 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-271de31b-e2db-406d-b683-64b87627c89f tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:39:58.939726 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-271de31b-e2db-406d-b683-64b87627c89f tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:58.940213 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-271de31b-e2db-406d-b683-64b87627c89f tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:58.940998 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-271de31b-e2db-406d-b683-64b87627c89f tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:58.941504 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-271de31b-e2db-406d-b683-64b87627c89f tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:59.003481 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-9bd3939c-b677-418c-97b7-80809a272c09 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac7d3acf1204a9f98f9ee14c2b46a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f46e472f8614c5e847ceb225cc9bff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:39:59.013023 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-9bd3939c-b677-418c-97b7-80809a272c09 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a" status: 200 len: 1367 microversion: 2.1 time: 0.287756 Aug 01 16:39:59.013756 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 43/82] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:39:58 2022] GET /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a => generated 1367 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:39:59.174080 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-271de31b-e2db-406d-b683-64b87627c89f tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:39:59.201885 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-d8a5c442-6b7b-4f67-91ed-b6255eac2a2d tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:39:59.203656 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-d8a5c442-6b7b-4f67-91ed-b6255eac2a2d tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: a3f6b512-e3cb-4e87-8d82-c64f6f1640db] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:39:59.207074 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-271de31b-e2db-406d-b683-64b87627c89f tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7" status: 200 len: 1322 microversion: 2.1 time: 0.305829 Aug 01 16:39:59.214911 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 40/83] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:39:58 2022] GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7 => generated 1322 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:39:59.219898 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-d8a5c442-6b7b-4f67-91ed-b6255eac2a2d tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:59.219898 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-d8a5c442-6b7b-4f67-91ed-b6255eac2a2d tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:59.220233 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-d8a5c442-6b7b-4f67-91ed-b6255eac2a2d tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:59.220848 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-d8a5c442-6b7b-4f67-91ed-b6255eac2a2d tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:59.417889 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-8773e7ba-3277-4ecf-a8ea-62c946543ea1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:39:59.420198 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-8773e7ba-3277-4ecf-a8ea-62c946543ea1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:39:59.434502 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-d8a5c442-6b7b-4f67-91ed-b6255eac2a2d tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0aed0278344119aae6906f4f52b1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b66d46c3e7d42b88f2dbdc01232fb03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:39:59.437850 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-8773e7ba-3277-4ecf-a8ea-62c946543ea1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:59.440108 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-8773e7ba-3277-4ecf-a8ea-62c946543ea1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:59.442151 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-8773e7ba-3277-4ecf-a8ea-62c946543ea1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:59.444342 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-d8a5c442-6b7b-4f67-91ed-b6255eac2a2d tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db" status: 200 len: 1362 microversion: 2.1 time: 0.249585 Aug 01 16:39:59.445678 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-8773e7ba-3277-4ecf-a8ea-62c946543ea1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:59.459405 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 44/84] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:39:59 2022] GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db => generated 1362 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:39:59.667895 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-8773e7ba-3277-4ecf-a8ea-62c946543ea1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:39:59.680244 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-8773e7ba-3277-4ecf-a8ea-62c946543ea1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:39:59.683325 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-8773e7ba-3277-4ecf-a8ea-62c946543ea1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:39:59.685435 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-8773e7ba-3277-4ecf-a8ea-62c946543ea1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1407 microversion: 2.20 time: 0.278959 Aug 01 16:39:59.700608 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 41/85] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:39:59 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1407 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:39:59.745900 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-bcd304ca-ecf1-4e52-b83b-8e4483cdd429 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:39:59.746559 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-bcd304ca-ecf1-4e52-b83b-8e4483cdd429 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] [instance: 97a3e151-77b3-424a-9e0c-8fd838b8fe23] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:39:59.758564 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-bcd304ca-ecf1-4e52-b83b-8e4483cdd429 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:59.759416 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-bcd304ca-ecf1-4e52-b83b-8e4483cdd429 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:39:59.760906 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-bcd304ca-ecf1-4e52-b83b-8e4483cdd429 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:39:59.761669 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-bcd304ca-ecf1-4e52-b83b-8e4483cdd429 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:00.035670 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-0b8852e1-63c0-417b-8c90-ff457ae8fc18 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:00.037383 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-0b8852e1-63c0-417b-8c90-ff457ae8fc18 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 430702ec-add7-4d23-a875-36d09e281f0a] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:00.045591 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-0b8852e1-63c0-417b-8c90-ff457ae8fc18 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:00.046352 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-0b8852e1-63c0-417b-8c90-ff457ae8fc18 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:00.047290 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-0b8852e1-63c0-417b-8c90-ff457ae8fc18 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:00.048073 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-0b8852e1-63c0-417b-8c90-ff457ae8fc18 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:00.879785 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-bcd304ca-ecf1-4e52-b83b-8e4483cdd429 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a310f36f74e4eaabd9f32220feb274a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d1d41a90df4eb8ae7b9a3934629614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:00.892175 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-bcd304ca-ecf1-4e52-b83b-8e4483cdd429 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] 10.222.0.45 "GET /compute/v2.1/servers/97a3e151-77b3-424a-9e0c-8fd838b8fe23" status: 200 len: 1314 microversion: 2.1 time: 1.149753 Aug 01 16:40:00.894078 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 45/86] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:39:59 2022] GET /compute/v2.1/servers/97a3e151-77b3-424a-9e0c-8fd838b8fe23 => generated 1314 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:40:00.904853 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-43b04d45-f4b6-4333-b3c8-724eb61b5516 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:00.908217 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-43b04d45-f4b6-4333-b3c8-724eb61b5516 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:00.924157 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-43b04d45-f4b6-4333-b3c8-724eb61b5516 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:00.924877 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-43b04d45-f4b6-4333-b3c8-724eb61b5516 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:00.926644 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-43b04d45-f4b6-4333-b3c8-724eb61b5516 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:00.928689 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-43b04d45-f4b6-4333-b3c8-724eb61b5516 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:01.349137 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-0b8852e1-63c0-417b-8c90-ff457ae8fc18 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac7d3acf1204a9f98f9ee14c2b46a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f46e472f8614c5e847ceb225cc9bff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:01.365276 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-0b8852e1-63c0-417b-8c90-ff457ae8fc18 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a" status: 200 len: 1367 microversion: 2.1 time: 1.333678 Aug 01 16:40:01.366993 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 42/87] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:40:00 2022] GET /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a => generated 1367 bytes in 1336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:40:01.376929 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-7d829f18-e954-46ae-b42f-4a8ff01d19d0 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:01.378234 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-7d829f18-e954-46ae-b42f-4a8ff01d19d0 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: a3f6b512-e3cb-4e87-8d82-c64f6f1640db] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:01.390539 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-7d829f18-e954-46ae-b42f-4a8ff01d19d0 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:01.391901 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-7d829f18-e954-46ae-b42f-4a8ff01d19d0 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:01.393355 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-7d829f18-e954-46ae-b42f-4a8ff01d19d0 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:01.394689 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-7d829f18-e954-46ae-b42f-4a8ff01d19d0 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:02.327619 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-43b04d45-f4b6-4333-b3c8-724eb61b5516 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:02.350244 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-43b04d45-f4b6-4333-b3c8-724eb61b5516 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7" status: 200 len: 1322 microversion: 2.1 time: 1.453180 Aug 01 16:40:02.351827 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 46/88] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:40:00 2022] GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7 => generated 1322 bytes in 1457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:40:02.354865 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-7d829f18-e954-46ae-b42f-4a8ff01d19d0 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0aed0278344119aae6906f4f52b1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b66d46c3e7d42b88f2dbdc01232fb03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:02.362644 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [req-3c5cc402-b6d7-4e38-9bb2-78d8cb9e36bc req-419df10e-a0fb-4765-b3e3-9046c783a435 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddf9be16-b3ce-411b-ac14-17dae5f41821", "name": "network-vif-plugged", "status": "completed", "tag": "896a3303-311c-4912-963a-aaa4ea080415"}]} {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:40:02.368783 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-7d829f18-e954-46ae-b42f-4a8ff01d19d0 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db" status: 200 len: 1362 microversion: 2.1 time: 0.999830 Aug 01 16:40:02.372803 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 43/89] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:40:01 2022] GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db => generated 1362 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:40:02.386107 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-3c5cc402-b6d7-4e38-9bb2-78d8cb9e36bc req-419df10e-a0fb-4765-b3e3-9046c783a435 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:02.387922 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-3c5cc402-b6d7-4e38-9bb2-78d8cb9e36bc req-419df10e-a0fb-4765-b3e3-9046c783a435 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:02.388324 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-d1ceeabe-6599-46b8-8e62-cb1076e93d3b tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:02.389154 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-d1ceeabe-6599-46b8-8e62-cb1076e93d3b tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:02.406923 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-d1ceeabe-6599-46b8-8e62-cb1076e93d3b tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:02.408045 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-d1ceeabe-6599-46b8-8e62-cb1076e93d3b tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:02.409834 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-d1ceeabe-6599-46b8-8e62-cb1076e93d3b tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:02.410825 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-d1ceeabe-6599-46b8-8e62-cb1076e93d3b tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:02.422848 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.compute.server_external_events [req-3c5cc402-b6d7-4e38-9bb2-78d8cb9e36bc req-419df10e-a0fb-4765-b3e3-9046c783a435 service nova] Creating event network-vif-plugged:896a3303-311c-4912-963a-aaa4ea080415 for instance ddf9be16-b3ce-411b-ac14-17dae5f41821 on hv-cinder-85032 Aug 01 16:40:02.439980 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [req-3c5cc402-b6d7-4e38-9bb2-78d8cb9e36bc req-419df10e-a0fb-4765-b3e3-9046c783a435 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084564 Aug 01 16:40:02.441960 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 47/90] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:40:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:40:02.459084 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-95e23849-f8ca-457d-a996-7040d3fd6418 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:02.461264 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-95e23849-f8ca-457d-a996-7040d3fd6418 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] [instance: 97a3e151-77b3-424a-9e0c-8fd838b8fe23] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:02.482528 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-95e23849-f8ca-457d-a996-7040d3fd6418 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:02.483504 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-95e23849-f8ca-457d-a996-7040d3fd6418 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:02.485034 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-95e23849-f8ca-457d-a996-7040d3fd6418 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:02.485759 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-95e23849-f8ca-457d-a996-7040d3fd6418 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:03.109703 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-d1ceeabe-6599-46b8-8e62-cb1076e93d3b tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:03.123356 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-d1ceeabe-6599-46b8-8e62-cb1076e93d3b tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:03.131549 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-d1ceeabe-6599-46b8-8e62-cb1076e93d3b tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:03.133646 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-d1ceeabe-6599-46b8-8e62-cb1076e93d3b tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1407 microversion: 2.20 time: 0.759365 Aug 01 16:40:03.135042 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 44/91] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:40:02 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1407 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:40:03.169706 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-c2302525-506a-47fb-ab8f-ed0a7a6fc555 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:03.171304 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-c2302525-506a-47fb-ab8f-ed0a7a6fc555 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 430702ec-add7-4d23-a875-36d09e281f0a] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:03.194765 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-c2302525-506a-47fb-ab8f-ed0a7a6fc555 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:03.199411 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-c2302525-506a-47fb-ab8f-ed0a7a6fc555 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:03.201311 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-c2302525-506a-47fb-ab8f-ed0a7a6fc555 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:03.218780 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-c2302525-506a-47fb-ab8f-ed0a7a6fc555 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:03.231084 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-95e23849-f8ca-457d-a996-7040d3fd6418 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a310f36f74e4eaabd9f32220feb274a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d1d41a90df4eb8ae7b9a3934629614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:03.286862 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-95e23849-f8ca-457d-a996-7040d3fd6418 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] 10.222.0.45 "GET /compute/v2.1/servers/97a3e151-77b3-424a-9e0c-8fd838b8fe23" status: 200 len: 1314 microversion: 2.1 time: 0.841172 Aug 01 16:40:03.290595 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 48/92] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:40:02 2022] GET /compute/v2.1/servers/97a3e151-77b3-424a-9e0c-8fd838b8fe23 => generated 1314 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:40:03.333094 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [req-17085fed-6e34-4d34-aae5-2accd30d1585 req-dbcde213-7141-404b-98c4-89472b47cded service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1c8ed71-ea21-4bca-91bf-febe7457300e", "tag": "734cefe8-e715-4af3-bebc-f135e61eb70c"}]} {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:40:03.370986 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-17085fed-6e34-4d34-aae5-2accd30d1585 req-dbcde213-7141-404b-98c4-89472b47cded service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:03.371784 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-17085fed-6e34-4d34-aae5-2accd30d1585 req-dbcde213-7141-404b-98c4-89472b47cded service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:03.413792 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.compute.server_external_events [req-17085fed-6e34-4d34-aae5-2accd30d1585 req-dbcde213-7141-404b-98c4-89472b47cded service nova] Creating event network-changed:734cefe8-e715-4af3-bebc-f135e61eb70c for instance f1c8ed71-ea21-4bca-91bf-febe7457300e on hv-cinder-85032 Aug 01 16:40:03.435522 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [req-17085fed-6e34-4d34-aae5-2accd30d1585 req-dbcde213-7141-404b-98c4-89472b47cded service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109748 Aug 01 16:40:03.450026 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 49/93] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:40:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:40:03.458893 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-bb4782d5-d684-4c18-8a22-f1bab352476d tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:03.460151 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-bb4782d5-d684-4c18-8a22-f1bab352476d tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:03.510314 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-bb4782d5-d684-4c18-8a22-f1bab352476d tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:03.514763 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-bb4782d5-d684-4c18-8a22-f1bab352476d tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:03.516668 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-bb4782d5-d684-4c18-8a22-f1bab352476d tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:03.517931 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-bb4782d5-d684-4c18-8a22-f1bab352476d tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:04.060446 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-c2302525-506a-47fb-ab8f-ed0a7a6fc555 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac7d3acf1204a9f98f9ee14c2b46a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f46e472f8614c5e847ceb225cc9bff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:04.079620 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-c2302525-506a-47fb-ab8f-ed0a7a6fc555 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a" status: 200 len: 1367 microversion: 2.1 time: 0.942724 Aug 01 16:40:04.081706 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 45/94] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:40:03 2022] GET /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a => generated 1367 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:40:04.093327 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-e29adb9f-766c-42c2-855a-caee61f5401f tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:04.094209 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-e29adb9f-766c-42c2-855a-caee61f5401f tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: a3f6b512-e3cb-4e87-8d82-c64f6f1640db] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:04.102887 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-e29adb9f-766c-42c2-855a-caee61f5401f tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:04.103597 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-e29adb9f-766c-42c2-855a-caee61f5401f tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:04.104595 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-e29adb9f-766c-42c2-855a-caee61f5401f tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:04.105172 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-e29adb9f-766c-42c2-855a-caee61f5401f tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:04.231105 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-bb4782d5-d684-4c18-8a22-f1bab352476d tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:04.257155 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-bb4782d5-d684-4c18-8a22-f1bab352476d tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7" status: 200 len: 1322 microversion: 2.1 time: 0.804112 Aug 01 16:40:04.258384 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 50/95] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:40:03 2022] GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7 => generated 1322 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:40:04.272591 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-80030b67-1b3d-4b45-b956-b5c6209b18c5 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:04.274313 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-80030b67-1b3d-4b45-b956-b5c6209b18c5 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:04.287965 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-80030b67-1b3d-4b45-b956-b5c6209b18c5 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:04.289064 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-80030b67-1b3d-4b45-b956-b5c6209b18c5 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:04.290640 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-80030b67-1b3d-4b45-b956-b5c6209b18c5 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:04.291974 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-80030b67-1b3d-4b45-b956-b5c6209b18c5 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:04.353811 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-e29adb9f-766c-42c2-855a-caee61f5401f tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0aed0278344119aae6906f4f52b1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b66d46c3e7d42b88f2dbdc01232fb03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:04.372014 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-e29adb9f-766c-42c2-855a-caee61f5401f tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db" status: 200 len: 1362 microversion: 2.1 time: 0.287282 Aug 01 16:40:04.373510 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 46/96] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:40:04 2022] GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db => generated 1362 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:40:04.385236 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-8965417a-11cb-4acd-8509-40b1814a2898 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:04.386742 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-8965417a-11cb-4acd-8509-40b1814a2898 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] [instance: 97a3e151-77b3-424a-9e0c-8fd838b8fe23] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:04.402989 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-8965417a-11cb-4acd-8509-40b1814a2898 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:04.403968 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-8965417a-11cb-4acd-8509-40b1814a2898 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:04.405065 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-8965417a-11cb-4acd-8509-40b1814a2898 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:04.405760 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-8965417a-11cb-4acd-8509-40b1814a2898 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:04.940073 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-80030b67-1b3d-4b45-b956-b5c6209b18c5 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:04.958828 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-8965417a-11cb-4acd-8509-40b1814a2898 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a310f36f74e4eaabd9f32220feb274a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d1d41a90df4eb8ae7b9a3934629614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:04.967783 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-8965417a-11cb-4acd-8509-40b1814a2898 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] 10.222.0.45 "GET /compute/v2.1/servers/97a3e151-77b3-424a-9e0c-8fd838b8fe23" status: 200 len: 1500 microversion: 2.1 time: 0.591490 Aug 01 16:40:04.970044 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 47/97] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:40:04 2022] GET /compute/v2.1/servers/97a3e151-77b3-424a-9e0c-8fd838b8fe23 => generated 1500 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:40:04.971572 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-80030b67-1b3d-4b45-b956-b5c6209b18c5 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:04.989113 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-80030b67-1b3d-4b45-b956-b5c6209b18c5 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:04.992484 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-80030b67-1b3d-4b45-b956-b5c6209b18c5 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1407 microversion: 2.20 time: 0.729998 Aug 01 16:40:05.008243 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 51/98] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:40:04 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1407 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:40:05.127377 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-d450ac6c-b963-4244-9a01-0748c21f586f tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:05.129693 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-d450ac6c-b963-4244-9a01-0748c21f586f tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 430702ec-add7-4d23-a875-36d09e281f0a] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:05.145843 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:05.148874 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-d450ac6c-b963-4244-9a01-0748c21f586f tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:05.149661 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-d450ac6c-b963-4244-9a01-0748c21f586f tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:05.151031 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-d450ac6c-b963-4244-9a01-0748c21f586f tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:05.151807 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-d450ac6c-b963-4244-9a01-0748c21f586f tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:05.280571 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-3bbba715-a75a-4787-a33a-7c0257511177 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:05.281466 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-3bbba715-a75a-4787-a33a-7c0257511177 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:05.290637 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3bbba715-a75a-4787-a33a-7c0257511177 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:05.295358 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3bbba715-a75a-4787-a33a-7c0257511177 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:05.296241 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3bbba715-a75a-4787-a33a-7c0257511177 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:05.299233 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3bbba715-a75a-4787-a33a-7c0257511177 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:05.806812 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-3bbba715-a75a-4787-a33a-7c0257511177 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:05.813875 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_cell1:SELECT=100 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:05.825371 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-3bbba715-a75a-4787-a33a-7c0257511177 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7" status: 200 len: 1322 microversion: 2.1 time: 0.549530 Aug 01 16:40:05.827685 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 52/99] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:40:05 2022] GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7 => generated 1322 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:40:05.839463 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-453f2bd3-a0cd-4acd-a6e6-533a4876d45e tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:05.849546 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-453f2bd3-a0cd-4acd-a6e6-533a4876d45e tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: a3f6b512-e3cb-4e87-8d82-c64f6f1640db] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:05.858631 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-453f2bd3-a0cd-4acd-a6e6-533a4876d45e tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:05.859232 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-453f2bd3-a0cd-4acd-a6e6-533a4876d45e tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:05.860142 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-453f2bd3-a0cd-4acd-a6e6-533a4876d45e tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:05.860681 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-453f2bd3-a0cd-4acd-a6e6-533a4876d45e tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:06.302893 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-d450ac6c-b963-4244-9a01-0748c21f586f tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac7d3acf1204a9f98f9ee14c2b46a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f46e472f8614c5e847ceb225cc9bff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:06.328784 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-d450ac6c-b963-4244-9a01-0748c21f586f tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a" status: 200 len: 1367 microversion: 2.1 time: 1.206223 Aug 01 16:40:06.333828 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 48/100] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:40:05 2022] GET /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a => generated 1367 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:40:06.351524 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [req-a70ad0a2-aa32-4081-8c90-640c313e0fe9 req-6351f1fc-fa0b-4163-aa17-011e4d52827a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "430702ec-add7-4d23-a875-36d09e281f0a", "tag": "06bd5b46-967d-4acc-87a2-ee936fcc3d78"}]} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:40:06.387587 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-a70ad0a2-aa32-4081-8c90-640c313e0fe9 req-6351f1fc-fa0b-4163-aa17-011e4d52827a service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:06.388394 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-a70ad0a2-aa32-4081-8c90-640c313e0fe9 req-6351f1fc-fa0b-4163-aa17-011e4d52827a service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:06.476402 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.compute.server_external_events [req-a70ad0a2-aa32-4081-8c90-640c313e0fe9 req-6351f1fc-fa0b-4163-aa17-011e4d52827a service nova] Creating event network-changed:06bd5b46-967d-4acc-87a2-ee936fcc3d78 for instance 430702ec-add7-4d23-a875-36d09e281f0a on hv-cinder-85032 Aug 01 16:40:06.516988 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [req-a70ad0a2-aa32-4081-8c90-640c313e0fe9 req-6351f1fc-fa0b-4163-aa17-011e4d52827a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.176927 Aug 01 16:40:06.521092 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 49/101] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:40:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:40:06.539302 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-35b2b684-0da4-4ab3-9580-dcbb4e816fd6 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:06.542584 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-35b2b684-0da4-4ab3-9580-dcbb4e816fd6 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:06.552747 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-35b2b684-0da4-4ab3-9580-dcbb4e816fd6 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:06.553931 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-35b2b684-0da4-4ab3-9580-dcbb4e816fd6 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:06.554995 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-35b2b684-0da4-4ab3-9580-dcbb4e816fd6 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:06.555666 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-35b2b684-0da4-4ab3-9580-dcbb4e816fd6 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:06.610402 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_cell0:SELECT=1 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:06.891755 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-453f2bd3-a0cd-4acd-a6e6-533a4876d45e tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0aed0278344119aae6906f4f52b1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b66d46c3e7d42b88f2dbdc01232fb03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:06.938164 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-453f2bd3-a0cd-4acd-a6e6-533a4876d45e tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db" status: 200 len: 1362 microversion: 2.1 time: 1.105942 Aug 01 16:40:06.940049 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 53/102] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:40:05 2022] GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db => generated 1362 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:40:06.971029 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [req-c35a096c-14ce-431d-aa9d-34fd984f5f34 req-b7577387-a10c-41fa-ae05-b9a21317ce7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3f6b512-e3cb-4e87-8d82-c64f6f1640db", "name": "network-vif-plugged", "status": "completed", "tag": "6a20ac6a-706d-492a-a5e3-62c35c931aa8"}]} {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:40:06.975497 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-35b2b684-0da4-4ab3-9580-dcbb4e816fd6 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:06.988691 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-35b2b684-0da4-4ab3-9580-dcbb4e816fd6 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:06.990848 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-35b2b684-0da4-4ab3-9580-dcbb4e816fd6 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:06.994538 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-35b2b684-0da4-4ab3-9580-dcbb4e816fd6 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1407 microversion: 2.20 time: 0.471412 Aug 01 16:40:07.007508 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-c35a096c-14ce-431d-aa9d-34fd984f5f34 req-b7577387-a10c-41fa-ae05-b9a21317ce7c service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:07.008991 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 50/103] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:40:06 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1407 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:40:07.012278 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-c35a096c-14ce-431d-aa9d-34fd984f5f34 req-b7577387-a10c-41fa-ae05-b9a21317ce7c service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:07.018988 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-a1634b99-8a75-407f-b54b-38774bc1ae3b tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "37713180-a2f5-4f22-916b-00b3e5f4f2f7"}} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:40:07.021999 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-a1634b99-8a75-407f-b54b-38774bc1ae3b tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] [instance: 97a3e151-77b3-424a-9e0c-8fd838b8fe23] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:07.033677 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-a1634b99-8a75-407f-b54b-38774bc1ae3b tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:07.034288 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-a1634b99-8a75-407f-b54b-38774bc1ae3b tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:07.036711 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-a1634b99-8a75-407f-b54b-38774bc1ae3b tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:07.037332 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-a1634b99-8a75-407f-b54b-38774bc1ae3b tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:07.067936 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.compute.server_external_events [req-c35a096c-14ce-431d-aa9d-34fd984f5f34 req-b7577387-a10c-41fa-ae05-b9a21317ce7c service nova] Creating event network-vif-plugged:6a20ac6a-706d-492a-a5e3-62c35c931aa8 for instance a3f6b512-e3cb-4e87-8d82-c64f6f1640db on hv-cinder-85032 Aug 01 16:40:07.086672 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [req-c35a096c-14ce-431d-aa9d-34fd984f5f34 req-b7577387-a10c-41fa-ae05-b9a21317ce7c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141456 Aug 01 16:40:07.087739 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 54/104] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:40:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:40:07.107698 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-b82b6dc5-3713-4fe6-bc42-79cbbac02197 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:07.116191 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-b82b6dc5-3713-4fe6-bc42-79cbbac02197 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:07.136249 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-b82b6dc5-3713-4fe6-bc42-79cbbac02197 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:07.137049 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-b82b6dc5-3713-4fe6-bc42-79cbbac02197 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:07.138369 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-b82b6dc5-3713-4fe6-bc42-79cbbac02197 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:07.146757 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-b82b6dc5-3713-4fe6-bc42-79cbbac02197 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:07.443053 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-b82b6dc5-3713-4fe6-bc42-79cbbac02197 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:07.463409 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-b82b6dc5-3713-4fe6-bc42-79cbbac02197 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7" status: 200 len: 1322 microversion: 2.1 time: 0.369001 Aug 01 16:40:07.465588 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 55/105] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:40:07 2022] GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7 => generated 1322 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:40:07.476565 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-ebb05670-25f6-4a37-812d-d8b1912e0771 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:07.478024 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-ebb05670-25f6-4a37-812d-d8b1912e0771 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 430702ec-add7-4d23-a875-36d09e281f0a] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:07.493770 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-ebb05670-25f6-4a37-812d-d8b1912e0771 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:07.496233 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-ebb05670-25f6-4a37-812d-d8b1912e0771 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:07.500571 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-ebb05670-25f6-4a37-812d-d8b1912e0771 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:07.501875 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-ebb05670-25f6-4a37-812d-d8b1912e0771 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:07.745605 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-ebb05670-25f6-4a37-812d-d8b1912e0771 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac7d3acf1204a9f98f9ee14c2b46a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f46e472f8614c5e847ceb225cc9bff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:07.773447 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-ebb05670-25f6-4a37-812d-d8b1912e0771 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a" status: 200 len: 1367 microversion: 2.1 time: 0.305748 Aug 01 16:40:07.788887 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 56/106] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:40:07 2022] GET /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a => generated 1367 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:40:07.966456 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-d87857ac-6747-48ad-80b8-c09bb9a1db37 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:07.968771 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-d87857ac-6747-48ad-80b8-c09bb9a1db37 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: a3f6b512-e3cb-4e87-8d82-c64f6f1640db] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:07.981361 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-d87857ac-6747-48ad-80b8-c09bb9a1db37 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:07.982315 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-d87857ac-6747-48ad-80b8-c09bb9a1db37 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:07.983590 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-d87857ac-6747-48ad-80b8-c09bb9a1db37 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:07.984554 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-d87857ac-6747-48ad-80b8-c09bb9a1db37 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:08.597713 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-d87857ac-6747-48ad-80b8-c09bb9a1db37 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0aed0278344119aae6906f4f52b1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b66d46c3e7d42b88f2dbdc01232fb03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:08.608705 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-d87857ac-6747-48ad-80b8-c09bb9a1db37 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db" status: 200 len: 1362 microversion: 2.1 time: 0.648541 Aug 01 16:40:08.625112 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 57/107] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:40:07 2022] GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db => generated 1362 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:40:08.632316 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-4a46eb5a-84fd-4114-bdb4-c20b27c56a37 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:08.633135 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-4a46eb5a-84fd-4114-bdb4-c20b27c56a37 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:08.646017 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-4a46eb5a-84fd-4114-bdb4-c20b27c56a37 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:08.646767 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-4a46eb5a-84fd-4114-bdb4-c20b27c56a37 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:08.648710 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-4a46eb5a-84fd-4114-bdb4-c20b27c56a37 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:08.649443 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-4a46eb5a-84fd-4114-bdb4-c20b27c56a37 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:08.915378 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-4a46eb5a-84fd-4114-bdb4-c20b27c56a37 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:08.935365 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-4a46eb5a-84fd-4114-bdb4-c20b27c56a37 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:08.950273 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-4a46eb5a-84fd-4114-bdb4-c20b27c56a37 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:08.952375 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-4a46eb5a-84fd-4114-bdb4-c20b27c56a37 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1407 microversion: 2.20 time: 0.325766 Aug 01 16:40:08.964807 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 58/108] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:40:08 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1407 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:40:09.001050 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-a5a2584e-f03d-4ccb-b4bc-0a5128eed7d2 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:09.004049 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-a5a2584e-f03d-4ccb-b4bc-0a5128eed7d2 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:09.038345 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a5a2584e-f03d-4ccb-b4bc-0a5128eed7d2 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:09.039317 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a5a2584e-f03d-4ccb-b4bc-0a5128eed7d2 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:09.041034 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a5a2584e-f03d-4ccb-b4bc-0a5128eed7d2 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:09.055528 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a5a2584e-f03d-4ccb-b4bc-0a5128eed7d2 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:09.431453 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-a1634b99-8a75-407f-b54b-38774bc1ae3b tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] 10.222.0.45 "POST /compute/v2.1/servers/97a3e151-77b3-424a-9e0c-8fd838b8fe23/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.420437 Aug 01 16:40:09.450384 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 51/109] 10.222.0.45 () {60 vars in 1323 bytes} [Mon Aug 1 16:40:07 2022] POST /compute/v2.1/servers/97a3e151-77b3-424a-9e0c-8fd838b8fe23/os-volume_attachments => generated 194 bytes in 2425 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:40:09.482569 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-9493403a-cc7b-4b61-a9f8-89e909834b26 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:09.487040 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-9493403a-cc7b-4b61-a9f8-89e909834b26 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 430702ec-add7-4d23-a875-36d09e281f0a] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:09.510991 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-9493403a-cc7b-4b61-a9f8-89e909834b26 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:09.511845 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-9493403a-cc7b-4b61-a9f8-89e909834b26 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:09.513735 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-9493403a-cc7b-4b61-a9f8-89e909834b26 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:09.515057 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-9493403a-cc7b-4b61-a9f8-89e909834b26 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:09.780123 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-a5a2584e-f03d-4ccb-b4bc-0a5128eed7d2 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:09.792230 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-a5a2584e-f03d-4ccb-b4bc-0a5128eed7d2 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7" status: 200 len: 1322 microversion: 2.1 time: 0.825232 Aug 01 16:40:09.792829 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 59/110] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:40:08 2022] GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7 => generated 1322 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:40:09.806335 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-fe82aa05-b9df-47e2-a8ca-0036466e2e5e tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:09.807169 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-fe82aa05-b9df-47e2-a8ca-0036466e2e5e tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: a3f6b512-e3cb-4e87-8d82-c64f6f1640db] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:09.832780 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-fe82aa05-b9df-47e2-a8ca-0036466e2e5e tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:09.833376 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-fe82aa05-b9df-47e2-a8ca-0036466e2e5e tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:09.834181 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-fe82aa05-b9df-47e2-a8ca-0036466e2e5e tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:09.834620 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-fe82aa05-b9df-47e2-a8ca-0036466e2e5e tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:09.966514 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-9493403a-cc7b-4b61-a9f8-89e909834b26 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac7d3acf1204a9f98f9ee14c2b46a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f46e472f8614c5e847ceb225cc9bff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:09.976026 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-9493403a-cc7b-4b61-a9f8-89e909834b26 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a" status: 200 len: 1367 microversion: 2.1 time: 0.522346 Aug 01 16:40:09.979328 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 52/111] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:40:09 2022] GET /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a => generated 1367 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:40:09.994898 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-1dba69ee-d45f-411e-9292-8cbac81905f2 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:09.995803 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-1dba69ee-d45f-411e-9292-8cbac81905f2 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:10.006368 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-1dba69ee-d45f-411e-9292-8cbac81905f2 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:10.010184 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-1dba69ee-d45f-411e-9292-8cbac81905f2 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:10.011192 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-1dba69ee-d45f-411e-9292-8cbac81905f2 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:10.015534 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-1dba69ee-d45f-411e-9292-8cbac81905f2 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:10.028764 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:10.287291 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-fe82aa05-b9df-47e2-a8ca-0036466e2e5e tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0aed0278344119aae6906f4f52b1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b66d46c3e7d42b88f2dbdc01232fb03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:10.297191 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-fe82aa05-b9df-47e2-a8ca-0036466e2e5e tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db" status: 200 len: 1362 microversion: 2.1 time: 0.494737 Aug 01 16:40:10.300754 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 60/112] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:40:09 2022] GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db => generated 1362 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:40:10.351593 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-1dba69ee-d45f-411e-9292-8cbac81905f2 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:10.365363 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-1dba69ee-d45f-411e-9292-8cbac81905f2 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:10.370357 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-1dba69ee-d45f-411e-9292-8cbac81905f2 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:10.370357 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-1dba69ee-d45f-411e-9292-8cbac81905f2 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1407 microversion: 2.20 time: 0.379354 Aug 01 16:40:10.371482 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 53/113] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:40:09 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1407 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 16:40:10.829722 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-bb2aab5e-958a-4cbe-bfd1-b7c5819621c5 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:10.830829 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-bb2aab5e-958a-4cbe-bfd1-b7c5819621c5 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:10.846354 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-bb2aab5e-958a-4cbe-bfd1-b7c5819621c5 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:10.847354 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-bb2aab5e-958a-4cbe-bfd1-b7c5819621c5 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:10.853765 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-bb2aab5e-958a-4cbe-bfd1-b7c5819621c5 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:10.856466 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-bb2aab5e-958a-4cbe-bfd1-b7c5819621c5 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:11.005795 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-d945ae57-8375-4ae6-8cc5-95727a6e3b15 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:11.007489 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-d945ae57-8375-4ae6-8cc5-95727a6e3b15 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 430702ec-add7-4d23-a875-36d09e281f0a] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:11.040093 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-d945ae57-8375-4ae6-8cc5-95727a6e3b15 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:11.041618 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-d945ae57-8375-4ae6-8cc5-95727a6e3b15 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:11.043207 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-d945ae57-8375-4ae6-8cc5-95727a6e3b15 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:11.043994 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-d945ae57-8375-4ae6-8cc5-95727a6e3b15 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:11.911919 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-bb2aab5e-958a-4cbe-bfd1-b7c5819621c5 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:11.931181 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-d945ae57-8375-4ae6-8cc5-95727a6e3b15 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac7d3acf1204a9f98f9ee14c2b46a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f46e472f8614c5e847ceb225cc9bff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:11.945186 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-d945ae57-8375-4ae6-8cc5-95727a6e3b15 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a" status: 200 len: 1367 microversion: 2.1 time: 0.944963 Aug 01 16:40:11.955938 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 54/114] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:40:10 2022] GET /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a => generated 1367 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:40:11.975870 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-2da64d5a-81ac-42b4-8030-85728413384f tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:11.979340 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-bb2aab5e-958a-4cbe-bfd1-b7c5819621c5 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7" status: 200 len: 1322 microversion: 2.1 time: 1.146434 Aug 01 16:40:11.989198 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-2da64d5a-81ac-42b4-8030-85728413384f tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: a3f6b512-e3cb-4e87-8d82-c64f6f1640db] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:11.993107 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 61/115] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:40:10 2022] GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7 => generated 1322 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:40:11.994828 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-2da64d5a-81ac-42b4-8030-85728413384f tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:11.996472 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-2da64d5a-81ac-42b4-8030-85728413384f tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:11.998053 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-2da64d5a-81ac-42b4-8030-85728413384f tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:11.998923 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-2da64d5a-81ac-42b4-8030-85728413384f tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:12.047064 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-3e41a105-a70b-4c9b-a27f-75f13a29e41c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:12.048208 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-3e41a105-a70b-4c9b-a27f-75f13a29e41c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:12.082494 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3e41a105-a70b-4c9b-a27f-75f13a29e41c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:12.083268 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3e41a105-a70b-4c9b-a27f-75f13a29e41c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:12.100581 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3e41a105-a70b-4c9b-a27f-75f13a29e41c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:12.118797 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3e41a105-a70b-4c9b-a27f-75f13a29e41c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:12.713540 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-2da64d5a-81ac-42b4-8030-85728413384f tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0aed0278344119aae6906f4f52b1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b66d46c3e7d42b88f2dbdc01232fb03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:12.730352 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-2da64d5a-81ac-42b4-8030-85728413384f tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db" status: 200 len: 1547 microversion: 2.1 time: 0.772115 Aug 01 16:40:12.748281 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 55/116] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:40:11 2022] GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db => generated 1547 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:40:12.759966 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [req-b6c19e1d-2b34-4209-963e-b998d1c1fb0d req-7f7ccfdd-b2a0-4a6d-a291-04e20ee93152 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1c8ed71-ea21-4bca-91bf-febe7457300e", "name": "network-vif-plugged", "status": "completed", "tag": "734cefe8-e715-4af3-bebc-f135e61eb70c"}]} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:40:12.764610 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-3e41a105-a70b-4c9b-a27f-75f13a29e41c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:12.773644 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-b6c19e1d-2b34-4209-963e-b998d1c1fb0d req-7f7ccfdd-b2a0-4a6d-a291-04e20ee93152 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:12.774264 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-b6c19e1d-2b34-4209-963e-b998d1c1fb0d req-7f7ccfdd-b2a0-4a6d-a291-04e20ee93152 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:12.783086 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-3e41a105-a70b-4c9b-a27f-75f13a29e41c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:12.787573 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-3e41a105-a70b-4c9b-a27f-75f13a29e41c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:12.790327 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-3e41a105-a70b-4c9b-a27f-75f13a29e41c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1407 microversion: 2.20 time: 0.795007 Aug 01 16:40:12.791856 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 62/117] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:40:11 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1407 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:40:12.801558 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-df810f20-1346-4c26-a4c8-70ff2ef3909a tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:12.802968 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-df810f20-1346-4c26-a4c8-70ff2ef3909a tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: a3f6b512-e3cb-4e87-8d82-c64f6f1640db] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:12.814845 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-df810f20-1346-4c26-a4c8-70ff2ef3909a tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:12.816215 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-df810f20-1346-4c26-a4c8-70ff2ef3909a tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:12.818122 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-df810f20-1346-4c26-a4c8-70ff2ef3909a tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:12.819144 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-df810f20-1346-4c26-a4c8-70ff2ef3909a tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:12.821491 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.compute.server_external_events [req-b6c19e1d-2b34-4209-963e-b998d1c1fb0d req-7f7ccfdd-b2a0-4a6d-a291-04e20ee93152 service nova] Creating event network-vif-plugged:734cefe8-e715-4af3-bebc-f135e61eb70c for instance f1c8ed71-ea21-4bca-91bf-febe7457300e on hv-cinder-85032 Aug 01 16:40:12.837846 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [req-b6c19e1d-2b34-4209-963e-b998d1c1fb0d req-7f7ccfdd-b2a0-4a6d-a291-04e20ee93152 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087345 Aug 01 16:40:12.838941 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 56/118] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:40:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:40:12.985652 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-8664e83d-899c-4e67-9721-493333d2384f tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:12.989813 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-8664e83d-899c-4e67-9721-493333d2384f tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 430702ec-add7-4d23-a875-36d09e281f0a] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:13.018396 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-8664e83d-899c-4e67-9721-493333d2384f tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:13.038396 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-8664e83d-899c-4e67-9721-493333d2384f tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:13.043894 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-8664e83d-899c-4e67-9721-493333d2384f tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:13.046464 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-8664e83d-899c-4e67-9721-493333d2384f tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:13.325615 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-df810f20-1346-4c26-a4c8-70ff2ef3909a tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.531131 Aug 01 16:40:13.334474 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 63/119] 10.222.0.45 () {58 vars in 1275 bytes} [Mon Aug 1 16:40:12 2022] GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db/os-interface => generated 284 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:40:13.342959 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-50c29fac-c4a1-4ab3-9b88-d4f233d27e8f tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:13.345508 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-50c29fac-c4a1-4ab3-9b88-d4f233d27e8f tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:13.379953 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-50c29fac-c4a1-4ab3-9b88-d4f233d27e8f tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:13.381481 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-50c29fac-c4a1-4ab3-9b88-d4f233d27e8f tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:13.384074 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-50c29fac-c4a1-4ab3-9b88-d4f233d27e8f tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:13.388809 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-50c29fac-c4a1-4ab3-9b88-d4f233d27e8f tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:13.529820 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-8664e83d-899c-4e67-9721-493333d2384f tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac7d3acf1204a9f98f9ee14c2b46a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f46e472f8614c5e847ceb225cc9bff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:13.545205 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-8664e83d-899c-4e67-9721-493333d2384f tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a" status: 200 len: 1367 microversion: 2.1 time: 0.573035 Aug 01 16:40:13.551699 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 57/120] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:40:12 2022] GET /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a => generated 1367 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:40:13.675011 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-50c29fac-c4a1-4ab3-9b88-d4f233d27e8f tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:13.692242 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-50c29fac-c4a1-4ab3-9b88-d4f233d27e8f tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7" status: 200 len: 1322 microversion: 2.1 time: 0.363205 Aug 01 16:40:13.695326 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 64/121] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:40:13 2022] GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7 => generated 1322 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:40:13.832777 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-6257a709-a92d-4e59-93a3-60698a94145c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:13.835068 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-6257a709-a92d-4e59-93a3-60698a94145c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:13.855308 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-6257a709-a92d-4e59-93a3-60698a94145c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:13.855799 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-6257a709-a92d-4e59-93a3-60698a94145c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:13.856606 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-6257a709-a92d-4e59-93a3-60698a94145c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:13.857049 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-6257a709-a92d-4e59-93a3-60698a94145c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:14.131023 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-6257a709-a92d-4e59-93a3-60698a94145c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:14.150230 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-6257a709-a92d-4e59-93a3-60698a94145c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:14.152823 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-6257a709-a92d-4e59-93a3-60698a94145c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:14.155914 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-6257a709-a92d-4e59-93a3-60698a94145c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1407 microversion: 2.20 time: 0.327509 Aug 01 16:40:14.157094 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 58/122] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:40:13 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1407 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 16:40:14.569414 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-a3f867c3-e054-4a7d-bb94-e213a2348f39 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:14.570202 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-a3f867c3-e054-4a7d-bb94-e213a2348f39 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 430702ec-add7-4d23-a875-36d09e281f0a] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:14.572194 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_api:SELECT=100 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:14.588177 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a3f867c3-e054-4a7d-bb94-e213a2348f39 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:14.588625 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a3f867c3-e054-4a7d-bb94-e213a2348f39 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:14.589426 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a3f867c3-e054-4a7d-bb94-e213a2348f39 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:14.589858 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a3f867c3-e054-4a7d-bb94-e213a2348f39 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:14.749318 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-514f03a1-bd58-49e1-8674-c9b4b8006937 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:14.754189 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-514f03a1-bd58-49e1-8674-c9b4b8006937 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:14.775946 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-514f03a1-bd58-49e1-8674-c9b4b8006937 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:14.777122 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-514f03a1-bd58-49e1-8674-c9b4b8006937 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:14.778855 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-514f03a1-bd58-49e1-8674-c9b4b8006937 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:14.779905 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-514f03a1-bd58-49e1-8674-c9b4b8006937 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:14.852967 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-a3f867c3-e054-4a7d-bb94-e213a2348f39 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac7d3acf1204a9f98f9ee14c2b46a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f46e472f8614c5e847ceb225cc9bff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:14.866525 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-a3f867c3-e054-4a7d-bb94-e213a2348f39 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a" status: 200 len: 1367 microversion: 2.1 time: 0.301653 Aug 01 16:40:14.870111 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 65/123] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:40:14 2022] GET /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a => generated 1367 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:40:15.062762 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [req-e972d5dc-be40-4395-88fd-5b10cd5f8045 req-40453446-6ff0-4dc5-bdb8-da4a93d1c02d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "430702ec-add7-4d23-a875-36d09e281f0a", "name": "network-vif-plugged", "status": "completed", "tag": "06bd5b46-967d-4acc-87a2-ee936fcc3d78"}, {"server_uuid": "d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7", "name": "network-vif-plugged", "status": "completed", "tag": "fe392c22-efae-48fa-84a5-56b4d266ae8b"}]} {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:40:15.087904 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-e972d5dc-be40-4395-88fd-5b10cd5f8045 req-40453446-6ff0-4dc5-bdb8-da4a93d1c02d service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:15.094524 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-e972d5dc-be40-4395-88fd-5b10cd5f8045 req-40453446-6ff0-4dc5-bdb8-da4a93d1c02d service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:15.127601 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.compute.server_external_events [req-e972d5dc-be40-4395-88fd-5b10cd5f8045 req-40453446-6ff0-4dc5-bdb8-da4a93d1c02d service nova] Creating event network-vif-plugged:06bd5b46-967d-4acc-87a2-ee936fcc3d78 for instance 430702ec-add7-4d23-a875-36d09e281f0a on hv-cinder-85032 Aug 01 16:40:15.130391 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.compute.server_external_events [req-e972d5dc-be40-4395-88fd-5b10cd5f8045 req-40453446-6ff0-4dc5-bdb8-da4a93d1c02d service nova] Creating event network-vif-plugged:fe392c22-efae-48fa-84a5-56b4d266ae8b for instance d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7 on hv-cinder-85032 Aug 01 16:40:15.149119 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [req-e972d5dc-be40-4395-88fd-5b10cd5f8045 req-40453446-6ff0-4dc5-bdb8-da4a93d1c02d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.087843 Aug 01 16:40:15.152559 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-514f03a1-bd58-49e1-8674-c9b4b8006937 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:15.154155 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 66/124] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:40:15 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 16:40:15.171606 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-514f03a1-bd58-49e1-8674-c9b4b8006937 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7" status: 200 len: 1322 microversion: 2.1 time: 0.441485 Aug 01 16:40:15.173745 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 59/125] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:40:14 2022] GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7 => generated 1322 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:40:15.195419 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-de13e51d-d48e-43fa-86f0-35e0806caca1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:15.196379 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-de13e51d-d48e-43fa-86f0-35e0806caca1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:15.211227 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-de13e51d-d48e-43fa-86f0-35e0806caca1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:15.213235 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-de13e51d-d48e-43fa-86f0-35e0806caca1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:15.214214 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-de13e51d-d48e-43fa-86f0-35e0806caca1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:15.214536 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-de13e51d-d48e-43fa-86f0-35e0806caca1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:15.622176 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-de13e51d-d48e-43fa-86f0-35e0806caca1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:15.643240 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-de13e51d-d48e-43fa-86f0-35e0806caca1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:15.645363 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-de13e51d-d48e-43fa-86f0-35e0806caca1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:15.646822 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-de13e51d-d48e-43fa-86f0-35e0806caca1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1407 microversion: 2.20 time: 0.456058 Aug 01 16:40:15.648049 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 67/126] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:40:15 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1407 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:40:15.908635 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-3f566a03-7f16-4026-ae6a-0bc2f71131a8 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:15.909233 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-3f566a03-7f16-4026-ae6a-0bc2f71131a8 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 430702ec-add7-4d23-a875-36d09e281f0a] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:15.925909 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-3f566a03-7f16-4026-ae6a-0bc2f71131a8 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:15.926365 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-3f566a03-7f16-4026-ae6a-0bc2f71131a8 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:15.927168 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-3f566a03-7f16-4026-ae6a-0bc2f71131a8 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:15.927602 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-3f566a03-7f16-4026-ae6a-0bc2f71131a8 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:16.195505 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-06f673af-d533-4ea2-9d72-6182063d17d4 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:16.196230 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-06f673af-d533-4ea2-9d72-6182063d17d4 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:16.209318 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-06f673af-d533-4ea2-9d72-6182063d17d4 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:16.210262 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-06f673af-d533-4ea2-9d72-6182063d17d4 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:16.212174 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-06f673af-d533-4ea2-9d72-6182063d17d4 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:16.213084 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-06f673af-d533-4ea2-9d72-6182063d17d4 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:16.399512 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-3f566a03-7f16-4026-ae6a-0bc2f71131a8 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac7d3acf1204a9f98f9ee14c2b46a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f46e472f8614c5e847ceb225cc9bff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:16.418798 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-3f566a03-7f16-4026-ae6a-0bc2f71131a8 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a" status: 200 len: 1367 microversion: 2.1 time: 0.519458 Aug 01 16:40:16.419712 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 60/127] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:40:15 2022] GET /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a => generated 1367 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:40:16.508352 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-06f673af-d533-4ea2-9d72-6182063d17d4 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:16.531253 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-06f673af-d533-4ea2-9d72-6182063d17d4 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7" status: 200 len: 1322 microversion: 2.1 time: 0.338596 Aug 01 16:40:16.532890 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 68/128] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:40:16 2022] GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7 => generated 1322 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:40:16.690633 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-3a538671-8fe4-4bfb-bf80-66170994bea1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:16.691915 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-3a538671-8fe4-4bfb-bf80-66170994bea1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:16.702764 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-3a538671-8fe4-4bfb-bf80-66170994bea1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:16.703512 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-3a538671-8fe4-4bfb-bf80-66170994bea1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:16.704601 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-3a538671-8fe4-4bfb-bf80-66170994bea1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:16.705344 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-3a538671-8fe4-4bfb-bf80-66170994bea1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:16.928778 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-3a538671-8fe4-4bfb-bf80-66170994bea1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:16.938910 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-3a538671-8fe4-4bfb-bf80-66170994bea1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:16.941147 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-3a538671-8fe4-4bfb-bf80-66170994bea1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:16.942224 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-3a538671-8fe4-4bfb-bf80-66170994bea1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1599 microversion: 2.20 time: 0.258673 Aug 01 16:40:16.960373 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 61/129] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:40:16 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1599 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:40:16.969902 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-56f16af8-9e19-4f8e-acda-29f4d82d5654 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:16.970776 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-56f16af8-9e19-4f8e-acda-29f4d82d5654 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:16.986642 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-56f16af8-9e19-4f8e-acda-29f4d82d5654 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:16.989235 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-56f16af8-9e19-4f8e-acda-29f4d82d5654 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:16.991060 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-56f16af8-9e19-4f8e-acda-29f4d82d5654 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:16.992511 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-56f16af8-9e19-4f8e-acda-29f4d82d5654 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:17.109961 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [req-c0e8b19a-02ed-4cc7-a63b-5e2e15cc5da4 req-58bd7942-398e-44a1-af95-b68953939c45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3f6b512-e3cb-4e87-8d82-c64f6f1640db", "tag": "6a20ac6a-706d-492a-a5e3-62c35c931aa8"}]} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:40:17.155635 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-c0e8b19a-02ed-4cc7-a63b-5e2e15cc5da4 req-58bd7942-398e-44a1-af95-b68953939c45 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:17.163736 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-c0e8b19a-02ed-4cc7-a63b-5e2e15cc5da4 req-58bd7942-398e-44a1-af95-b68953939c45 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:17.200817 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-56f16af8-9e19-4f8e-acda-29f4d82d5654 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.238277 Aug 01 16:40:17.201878 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 69/130] 10.222.0.45 () {60 vars in 1316 bytes} [Mon Aug 1 16:40:16 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e/os-interface => generated 284 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 16:40:17.216676 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.compute.server_external_events [req-c0e8b19a-02ed-4cc7-a63b-5e2e15cc5da4 req-58bd7942-398e-44a1-af95-b68953939c45 service nova] Creating event network-changed:6a20ac6a-706d-492a-a5e3-62c35c931aa8 for instance a3f6b512-e3cb-4e87-8d82-c64f6f1640db on hv-cinder-85032 Aug 01 16:40:17.236175 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [req-c0e8b19a-02ed-4cc7-a63b-5e2e15cc5da4 req-58bd7942-398e-44a1-af95-b68953939c45 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136065 Aug 01 16:40:17.238084 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 62/131] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:40:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 16:40:17.458412 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-dc89bde2-55af-42ae-b196-5a4b23286cba tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:17.459564 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-dc89bde2-55af-42ae-b196-5a4b23286cba tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 430702ec-add7-4d23-a875-36d09e281f0a] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:17.470315 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-dc89bde2-55af-42ae-b196-5a4b23286cba tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:17.471053 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-dc89bde2-55af-42ae-b196-5a4b23286cba tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:17.473494 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-dc89bde2-55af-42ae-b196-5a4b23286cba tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:17.474307 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-dc89bde2-55af-42ae-b196-5a4b23286cba tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:17.566979 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-d246bc7b-e63d-42d7-9808-9e89ef071b5a tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:17.568368 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-d246bc7b-e63d-42d7-9808-9e89ef071b5a tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:17.582752 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-d246bc7b-e63d-42d7-9808-9e89ef071b5a tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:17.590686 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-d246bc7b-e63d-42d7-9808-9e89ef071b5a tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:17.591713 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-d246bc7b-e63d-42d7-9808-9e89ef071b5a tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:17.593777 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-d246bc7b-e63d-42d7-9808-9e89ef071b5a tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:18.094529 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-dc89bde2-55af-42ae-b196-5a4b23286cba tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac7d3acf1204a9f98f9ee14c2b46a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f46e472f8614c5e847ceb225cc9bff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:18.106840 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-dc89bde2-55af-42ae-b196-5a4b23286cba tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a" status: 200 len: 1367 microversion: 2.1 time: 0.656823 Aug 01 16:40:18.110110 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 70/132] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:40:17 2022] GET /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a => generated 1367 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:40:18.546367 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-d246bc7b-e63d-42d7-9808-9e89ef071b5a tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:18.562476 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-d246bc7b-e63d-42d7-9808-9e89ef071b5a tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7" status: 200 len: 1322 microversion: 2.1 time: 1.001026 Aug 01 16:40:18.570664 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 63/133] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:40:17 2022] GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7 => generated 1322 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:40:19.141529 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-3aef8504-51c2-4bab-90d4-9bb9411afd05 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:19.143238 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-3aef8504-51c2-4bab-90d4-9bb9411afd05 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 430702ec-add7-4d23-a875-36d09e281f0a] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:19.150284 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3aef8504-51c2-4bab-90d4-9bb9411afd05 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:19.155276 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3aef8504-51c2-4bab-90d4-9bb9411afd05 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:19.157683 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3aef8504-51c2-4bab-90d4-9bb9411afd05 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:19.163475 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3aef8504-51c2-4bab-90d4-9bb9411afd05 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:19.210971 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_cell1:SELECT=100 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:19.587115 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-e46cd7e5-48d4-4658-9940-d98a491e6794 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:19.588227 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-e46cd7e5-48d4-4658-9940-d98a491e6794 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:19.600979 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-3aef8504-51c2-4bab-90d4-9bb9411afd05 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac7d3acf1204a9f98f9ee14c2b46a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f46e472f8614c5e847ceb225cc9bff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:19.607391 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-e46cd7e5-48d4-4658-9940-d98a491e6794 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:19.610062 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-e46cd7e5-48d4-4658-9940-d98a491e6794 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:19.610925 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-e46cd7e5-48d4-4658-9940-d98a491e6794 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:19.611374 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-e46cd7e5-48d4-4658-9940-d98a491e6794 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:19.616713 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-3aef8504-51c2-4bab-90d4-9bb9411afd05 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a" status: 200 len: 1367 microversion: 2.1 time: 0.479372 Aug 01 16:40:19.630158 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 71/134] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:40:19 2022] GET /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a => generated 1367 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:40:20.160743 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-e46cd7e5-48d4-4658-9940-d98a491e6794 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:20.178229 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-e46cd7e5-48d4-4658-9940-d98a491e6794 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7" status: 200 len: 1516 microversion: 2.1 time: 0.596592 Aug 01 16:40:20.180188 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 64/135] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:40:19 2022] GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7 => generated 1516 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:40:20.202213 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-242f21d7-4f74-4ee2-ab81-4476ec5baf19 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:40:20.205946 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-242f21d7-4f74-4ee2-ab81-4476ec5baf19 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:20.213284 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-242f21d7-4f74-4ee2-ab81-4476ec5baf19 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:20.217826 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-242f21d7-4f74-4ee2-ab81-4476ec5baf19 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:20.218913 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-242f21d7-4f74-4ee2-ab81-4476ec5baf19 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:20.219503 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-242f21d7-4f74-4ee2-ab81-4476ec5baf19 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:20.256234 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.objects.instance [None req-242f21d7-4f74-4ee2-ab81-4476ec5baf19 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lazy-loading 'flavor' on Instance uuid d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7 {{(pid=118118) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 16:40:20.433485 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [req-093c9a31-664e-40ae-9ecd-02de001bb5c8 req-3d6d9b26-b59a-48ac-9407-fac0a0d258a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1c8ed71-ea21-4bca-91bf-febe7457300e", "tag": "734cefe8-e715-4af3-bebc-f135e61eb70c"}]} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:40:20.467712 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-093c9a31-664e-40ae-9ecd-02de001bb5c8 req-3d6d9b26-b59a-48ac-9407-fac0a0d258a1 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:20.480736 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-093c9a31-664e-40ae-9ecd-02de001bb5c8 req-3d6d9b26-b59a-48ac-9407-fac0a0d258a1 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:20.496862 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-242f21d7-4f74-4ee2-ab81-4476ec5baf19 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "POST /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7/action" status: 200 len: 32 microversion: 2.1 time: 0.298662 Aug 01 16:40:20.498739 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 72/136] 10.222.0.45 () {60 vars in 1278 bytes} [Mon Aug 1 16:40:20 2022] POST /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7/action => generated 32 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 16:40:20.509111 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-7aab66a3-d616-4247-a2fb-4760d9d33354 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:20.509304 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.compute.server_external_events [req-093c9a31-664e-40ae-9ecd-02de001bb5c8 req-3d6d9b26-b59a-48ac-9407-fac0a0d258a1 service nova] Creating event network-changed:734cefe8-e715-4af3-bebc-f135e61eb70c for instance f1c8ed71-ea21-4bca-91bf-febe7457300e on hv-cinder-85032 Aug 01 16:40:20.513685 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-7aab66a3-d616-4247-a2fb-4760d9d33354 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:20.523853 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [req-093c9a31-664e-40ae-9ecd-02de001bb5c8 req-3d6d9b26-b59a-48ac-9407-fac0a0d258a1 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096191 Aug 01 16:40:20.525157 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 65/137] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:40:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:40:20.533105 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-7aab66a3-d616-4247-a2fb-4760d9d33354 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:20.533557 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-7aab66a3-d616-4247-a2fb-4760d9d33354 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:20.535118 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-7aab66a3-d616-4247-a2fb-4760d9d33354 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:20.536162 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-7aab66a3-d616-4247-a2fb-4760d9d33354 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:20.665114 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-b2e35862-26b0-4cc9-ae0b-ebcf76998aae tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:20.665814 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-b2e35862-26b0-4cc9-ae0b-ebcf76998aae tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 430702ec-add7-4d23-a875-36d09e281f0a] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:20.691338 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-b2e35862-26b0-4cc9-ae0b-ebcf76998aae tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:20.693349 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-b2e35862-26b0-4cc9-ae0b-ebcf76998aae tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:20.694853 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-b2e35862-26b0-4cc9-ae0b-ebcf76998aae tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:20.695565 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-b2e35862-26b0-4cc9-ae0b-ebcf76998aae tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:20.909864 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-7aab66a3-d616-4247-a2fb-4760d9d33354 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:20.927363 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-7aab66a3-d616-4247-a2fb-4760d9d33354 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7" status: 200 len: 1522 microversion: 2.1 time: 0.421374 Aug 01 16:40:20.931626 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 73/138] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:40:20 2022] GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7 => generated 1522 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:40:21.017974 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-b2e35862-26b0-4cc9-ae0b-ebcf76998aae tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac7d3acf1204a9f98f9ee14c2b46a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f46e472f8614c5e847ceb225cc9bff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:21.029756 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-b2e35862-26b0-4cc9-ae0b-ebcf76998aae tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a" status: 200 len: 1555 microversion: 2.1 time: 0.369816 Aug 01 16:40:21.044963 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 66/139] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:40:20 2022] GET /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a => generated 1555 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:40:21.054841 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-fe066f02-ed58-41b8-9a42-57045501bbf2 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:21.055346 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-fe066f02-ed58-41b8-9a42-57045501bbf2 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 430702ec-add7-4d23-a875-36d09e281f0a] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:21.068589 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-fe066f02-ed58-41b8-9a42-57045501bbf2 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:21.069046 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-fe066f02-ed58-41b8-9a42-57045501bbf2 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:21.069846 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-fe066f02-ed58-41b8-9a42-57045501bbf2 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:21.070276 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-fe066f02-ed58-41b8-9a42-57045501bbf2 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:21.329271 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-fe066f02-ed58-41b8-9a42-57045501bbf2 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.278342 Aug 01 16:40:21.336670 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 74/140] 10.222.0.45 () {58 vars in 1275 bytes} [Mon Aug 1 16:40:21 2022] GET /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a/os-interface => generated 284 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:40:21.952383 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-34ea7894-1d85-4797-9907-4b1c0f580244 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:21.953742 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-34ea7894-1d85-4797-9907-4b1c0f580244 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:21.969430 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-34ea7894-1d85-4797-9907-4b1c0f580244 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:21.973335 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-34ea7894-1d85-4797-9907-4b1c0f580244 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:21.974408 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-34ea7894-1d85-4797-9907-4b1c0f580244 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:21.989327 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-34ea7894-1d85-4797-9907-4b1c0f580244 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:22.474309 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-674289a0-6230-44b0-a6e8-1fb7b6e4e626 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:22.475224 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-674289a0-6230-44b0-a6e8-1fb7b6e4e626 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] [instance: 97a3e151-77b3-424a-9e0c-8fd838b8fe23] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:22.495517 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-674289a0-6230-44b0-a6e8-1fb7b6e4e626 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:22.496671 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-674289a0-6230-44b0-a6e8-1fb7b6e4e626 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:22.497536 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-674289a0-6230-44b0-a6e8-1fb7b6e4e626 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:22.497997 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-674289a0-6230-44b0-a6e8-1fb7b6e4e626 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:22.607881 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-674289a0-6230-44b0-a6e8-1fb7b6e4e626 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] [instance: 97a3e151-77b3-424a-9e0c-8fd838b8fe23] Going to try to terminate instance {{(pid=118118) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 16:40:22.882681 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-674289a0-6230-44b0-a6e8-1fb7b6e4e626 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] 10.222.0.45 "DELETE /compute/v2.1/servers/97a3e151-77b3-424a-9e0c-8fd838b8fe23" status: 204 len: 0 microversion: 2.1 time: 0.417105 Aug 01 16:40:22.883901 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 75/141] 10.222.0.45 () {58 vars in 1239 bytes} [Mon Aug 1 16:40:22 2022] DELETE /compute/v2.1/servers/97a3e151-77b3-424a-9e0c-8fd838b8fe23 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 16:40:22.910764 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-62745a97-46ae-40b1-8097-2e1a57fbc2cd tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:22.913828 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-62745a97-46ae-40b1-8097-2e1a57fbc2cd tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] [instance: 97a3e151-77b3-424a-9e0c-8fd838b8fe23] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:22.946249 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-62745a97-46ae-40b1-8097-2e1a57fbc2cd tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:22.947089 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-62745a97-46ae-40b1-8097-2e1a57fbc2cd tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:22.948706 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-62745a97-46ae-40b1-8097-2e1a57fbc2cd tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:22.949995 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-62745a97-46ae-40b1-8097-2e1a57fbc2cd tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:23.047642 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-34ea7894-1d85-4797-9907-4b1c0f580244 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:23.065602 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-34ea7894-1d85-4797-9907-4b1c0f580244 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7" status: 200 len: 1522 microversion: 2.1 time: 1.118192 Aug 01 16:40:23.067532 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 67/142] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:40:21 2022] GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7 => generated 1522 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:40:23.678466 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-62745a97-46ae-40b1-8097-2e1a57fbc2cd tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a310f36f74e4eaabd9f32220feb274a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d1d41a90df4eb8ae7b9a3934629614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:23.698720 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-62745a97-46ae-40b1-8097-2e1a57fbc2cd tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] 10.222.0.45 "GET /compute/v2.1/servers/97a3e151-77b3-424a-9e0c-8fd838b8fe23" status: 200 len: 1552 microversion: 2.1 time: 0.807635 Aug 01 16:40:23.699360 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 76/143] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:40:22 2022] GET /compute/v2.1/servers/97a3e151-77b3-424a-9e0c-8fd838b8fe23 => generated 1552 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:40:24.105701 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-968ecccc-fd51-4bd0-aaa7-23a337931626 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:24.106473 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-968ecccc-fd51-4bd0-aaa7-23a337931626 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:24.120260 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-968ecccc-fd51-4bd0-aaa7-23a337931626 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:24.123479 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-968ecccc-fd51-4bd0-aaa7-23a337931626 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:24.124870 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-968ecccc-fd51-4bd0-aaa7-23a337931626 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:24.126366 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-968ecccc-fd51-4bd0-aaa7-23a337931626 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:24.736653 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-1ff58c07-2660-40f5-ab70-ef53f3466840 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:24.740363 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-1ff58c07-2660-40f5-ab70-ef53f3466840 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] [instance: 97a3e151-77b3-424a-9e0c-8fd838b8fe23] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:24.751912 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-1ff58c07-2660-40f5-ab70-ef53f3466840 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:24.752668 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-1ff58c07-2660-40f5-ab70-ef53f3466840 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:24.754328 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-1ff58c07-2660-40f5-ab70-ef53f3466840 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:24.754768 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-1ff58c07-2660-40f5-ab70-ef53f3466840 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:25.155181 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-968ecccc-fd51-4bd0-aaa7-23a337931626 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:25.188608 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-968ecccc-fd51-4bd0-aaa7-23a337931626 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7" status: 200 len: 1522 microversion: 2.1 time: 1.082150 Aug 01 16:40:25.190765 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 68/144] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:40:24 2022] GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7 => generated 1522 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:40:25.532163 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-1ff58c07-2660-40f5-ab70-ef53f3466840 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a310f36f74e4eaabd9f32220feb274a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d1d41a90df4eb8ae7b9a3934629614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:25.575376 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-1ff58c07-2660-40f5-ab70-ef53f3466840 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] 10.222.0.45 "GET /compute/v2.1/servers/97a3e151-77b3-424a-9e0c-8fd838b8fe23" status: 200 len: 1552 microversion: 2.1 time: 0.828332 Aug 01 16:40:25.577877 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 77/145] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:40:24 2022] GET /compute/v2.1/servers/97a3e151-77b3-424a-9e0c-8fd838b8fe23 => generated 1552 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:40:26.236837 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-7f02cc8e-b8d4-477e-9ac1-ea7c7c6f9de6 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:26.237816 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-7f02cc8e-b8d4-477e-9ac1-ea7c7c6f9de6 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:26.276681 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-7f02cc8e-b8d4-477e-9ac1-ea7c7c6f9de6 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:26.277165 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-7f02cc8e-b8d4-477e-9ac1-ea7c7c6f9de6 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:26.278959 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-7f02cc8e-b8d4-477e-9ac1-ea7c7c6f9de6 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:26.280751 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-7f02cc8e-b8d4-477e-9ac1-ea7c7c6f9de6 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:26.595416 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [req-1732696a-bafe-442d-96de-c931878d5a63 req-5e2189ca-4c3b-4ce4-bb66-88a0e0c5f8ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "430702ec-add7-4d23-a875-36d09e281f0a", "tag": "06bd5b46-967d-4acc-87a2-ee936fcc3d78"}]} {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:40:26.618615 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-1732696a-bafe-442d-96de-c931878d5a63 req-5e2189ca-4c3b-4ce4-bb66-88a0e0c5f8ce service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:26.621749 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-1732696a-bafe-442d-96de-c931878d5a63 req-5e2189ca-4c3b-4ce4-bb66-88a0e0c5f8ce service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:26.656325 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.compute.server_external_events [req-1732696a-bafe-442d-96de-c931878d5a63 req-5e2189ca-4c3b-4ce4-bb66-88a0e0c5f8ce service nova] Creating event network-changed:06bd5b46-967d-4acc-87a2-ee936fcc3d78 for instance 430702ec-add7-4d23-a875-36d09e281f0a on hv-cinder-85032 Aug 01 16:40:26.666380 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [req-1732696a-bafe-442d-96de-c931878d5a63 req-5e2189ca-4c3b-4ce4-bb66-88a0e0c5f8ce service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076963 Aug 01 16:40:26.681299 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 78/146] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:40:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:40:26.701539 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-7dba5e59-cc10-421a-9efe-5678633568d8 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:26.702337 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-7dba5e59-cc10-421a-9efe-5678633568d8 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] [instance: 97a3e151-77b3-424a-9e0c-8fd838b8fe23] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:26.716916 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-7dba5e59-cc10-421a-9efe-5678633568d8 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:26.717644 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-7dba5e59-cc10-421a-9efe-5678633568d8 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:26.720107 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-7dba5e59-cc10-421a-9efe-5678633568d8 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:26.723011 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-7dba5e59-cc10-421a-9efe-5678633568d8 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:26.971224 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-7dba5e59-cc10-421a-9efe-5678633568d8 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a310f36f74e4eaabd9f32220feb274a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d1d41a90df4eb8ae7b9a3934629614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:26.993439 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-7f02cc8e-b8d4-477e-9ac1-ea7c7c6f9de6 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:27.004375 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-7dba5e59-cc10-421a-9efe-5678633568d8 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] 10.222.0.45 "GET /compute/v2.1/servers/97a3e151-77b3-424a-9e0c-8fd838b8fe23" status: 200 len: 1510 microversion: 2.1 time: 0.303765 Aug 01 16:40:27.005063 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 79/147] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:40:26 2022] GET /compute/v2.1/servers/97a3e151-77b3-424a-9e0c-8fd838b8fe23 => generated 1510 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:40:27.024556 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-7f02cc8e-b8d4-477e-9ac1-ea7c7c6f9de6 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7" status: 200 len: 1522 microversion: 2.1 time: 0.787895 Aug 01 16:40:27.025471 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 69/148] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:40:26 2022] GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7 => generated 1522 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:40:27.031278 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [req-989a6e4b-d973-4783-88b9-7d7d0a2e7eb0 req-c54d3456-fb7b-4083-8204-c7b12eee200c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97a3e151-77b3-424a-9e0c-8fd838b8fe23", "name": "network-vif-deleted", "tag": "8ab1f8c1-69bb-4671-98fe-5bb145658c82"}]} {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:40:27.053118 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-989a6e4b-d973-4783-88b9-7d7d0a2e7eb0 req-c54d3456-fb7b-4083-8204-c7b12eee200c service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:27.053856 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-989a6e4b-d973-4783-88b9-7d7d0a2e7eb0 req-c54d3456-fb7b-4083-8204-c7b12eee200c service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:27.076460 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.compute.server_external_events [req-989a6e4b-d973-4783-88b9-7d7d0a2e7eb0 req-c54d3456-fb7b-4083-8204-c7b12eee200c service nova] Creating event network-vif-deleted:8ab1f8c1-69bb-4671-98fe-5bb145658c82 for instance 97a3e151-77b3-424a-9e0c-8fd838b8fe23 on hv-cinder-85032 Aug 01 16:40:27.089183 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [req-989a6e4b-d973-4783-88b9-7d7d0a2e7eb0 req-c54d3456-fb7b-4083-8204-c7b12eee200c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082724 Aug 01 16:40:27.094362 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 80/149] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:40:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:40:28.033483 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-9f15298b-815b-4746-a417-a8c25b1ae8e5 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:28.034142 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-9f15298b-815b-4746-a417-a8c25b1ae8e5 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] [instance: 97a3e151-77b3-424a-9e0c-8fd838b8fe23] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:28.048209 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-1a6d972e-abfd-4172-bc21-a305826985f7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:28.049539 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-1a6d972e-abfd-4172-bc21-a305826985f7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:28.049825 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-9f15298b-815b-4746-a417-a8c25b1ae8e5 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:28.050283 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-9f15298b-815b-4746-a417-a8c25b1ae8e5 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:28.051075 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-9f15298b-815b-4746-a417-a8c25b1ae8e5 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:28.051515 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-9f15298b-815b-4746-a417-a8c25b1ae8e5 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:28.061010 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-1a6d972e-abfd-4172-bc21-a305826985f7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:28.074880 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-1a6d972e-abfd-4172-bc21-a305826985f7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:28.076647 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-1a6d972e-abfd-4172-bc21-a305826985f7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:28.078972 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-1a6d972e-abfd-4172-bc21-a305826985f7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:28.149574 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-9f15298b-815b-4746-a417-a8c25b1ae8e5 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:28.150009 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-9f15298b-815b-4746-a417-a8c25b1ae8e5 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:28.150651 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.objects.instance [None req-9f15298b-815b-4746-a417-a8c25b1ae8e5 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lazy-loading 'fault' on Instance uuid 97a3e151-77b3-424a-9e0c-8fd838b8fe23 {{(pid=118117) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 16:40:28.697260 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-9f15298b-815b-4746-a417-a8c25b1ae8e5 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a310f36f74e4eaabd9f32220feb274a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6d1d41a90df4eb8ae7b9a3934629614', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:28.705758 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-9f15298b-815b-4746-a417-a8c25b1ae8e5 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] 10.222.0.45 "GET /compute/v2.1/servers/97a3e151-77b3-424a-9e0c-8fd838b8fe23" status: 200 len: 1304 microversion: 2.1 time: 0.676386 Aug 01 16:40:28.708508 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 70/150] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:40:28 2022] GET /compute/v2.1/servers/97a3e151-77b3-424a-9e0c-8fd838b8fe23 => generated 1304 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:40:28.952660 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-1a6d972e-abfd-4172-bc21-a305826985f7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:28.968611 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-1a6d972e-abfd-4172-bc21-a305826985f7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7" status: 200 len: 1522 microversion: 2.1 time: 0.925645 Aug 01 16:40:28.993520 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 81/151] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:40:28 2022] GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7 => generated 1522 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:40:29.750321 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-a26bd3e7-51ad-4bbe-9ca6-1db25d4e9026 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:29.751460 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-a26bd3e7-51ad-4bbe-9ca6-1db25d4e9026 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] [instance: 97a3e151-77b3-424a-9e0c-8fd838b8fe23] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:29.769782 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-a26bd3e7-51ad-4bbe-9ca6-1db25d4e9026 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:29.770642 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-a26bd3e7-51ad-4bbe-9ca6-1db25d4e9026 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:29.773491 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-a26bd3e7-51ad-4bbe-9ca6-1db25d4e9026 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:29.774592 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-a26bd3e7-51ad-4bbe-9ca6-1db25d4e9026 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:29.794216 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.wsgi [None req-a26bd3e7-51ad-4bbe-9ca6-1db25d4e9026 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] HTTP exception thrown: Instance 97a3e151-77b3-424a-9e0c-8fd838b8fe23 could not be found. Aug 01 16:40:29.799333 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-a26bd3e7-51ad-4bbe-9ca6-1db25d4e9026 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Request method failure captured: Aug 01 16:40:29.799333 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: request: GET /compute/v2.1/servers/97a3e151-77b3-424a-9e0c-8fd838b8fe23 HTTP/1.1 Aug 01 16:40:29.799333 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Accept: application/json Aug 01 16:40:29.799333 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Accept-Encoding: identity Aug 01 16:40:29.799333 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Connection: close Aug 01 16:40:29.799333 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Content-Length: 0 Aug 01 16:40:29.799333 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Content-Type: application/json Aug 01 16:40:29.799333 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Host: 10.222.0.45 Aug 01 16:40:29.799333 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Openstack-System-Scope: None Aug 01 16:40:29.799333 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: User-Agent: python-urllib3/1.26.10 Aug 01 16:40:29.799333 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Auth-Token: gAAAAABi6AGuHkwhAgUw-Y7eMxR77eU7phfAxT387BOdo6eU3nzkDeFbZcDWUvScZ66IrImiTusmRI19kWz-1vSQVcRPf32tauWrDWfjgdo5hCuANFTByDpxTsipK0blVm6A9K8GhzUO0I9NQQiQzIuQBPdabYcAxwrRyQDn7NLjZdD9quzuB9A Aug 01 16:40:29.799333 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Domain-Id: None Aug 01 16:40:29.799333 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Domain-Name: None Aug 01 16:40:29.799333 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Identity-Status: Confirmed Aug 01 16:40:29.799333 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Is-Admin-Project: True Aug 01 16:40:29.799333 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Domain-Id: default Aug 01 16:40:29.799333 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Domain-Name: Default Aug 01 16:40:29.799333 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Id: c6d1d41a90df4eb8ae7b9a3934629614 Aug 01 16:40:29.799333 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Name: tempest-DeleteServersTestJSON-688058315 Aug 01 16:40:29.799333 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Role: reader,member Aug 01 16:40:29.799333 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Roles: reader,member Aug 01 16:40:29.800835 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c6d1d41a90df4eb8ae7b9a3934629614"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c6d1d41a90df4eb8ae7b9a3934629614"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c6d1d41a90df4eb8ae7b9a3934629614"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c6d1d41a90df4eb8ae7b9a3934629614"}]}] Aug 01 16:40:29.800835 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Tenant: tempest-DeleteServersTestJSON-688058315 Aug 01 16:40:29.800835 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Tenant-Id: c6d1d41a90df4eb8ae7b9a3934629614 Aug 01 16:40:29.800835 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Tenant-Name: tempest-DeleteServersTestJSON-688058315 Aug 01 16:40:29.800835 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User: tempest-DeleteServersTestJSON-688058315-project Aug 01 16:40:29.800835 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Domain-Id: default Aug 01 16:40:29.800835 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Domain-Name: Default Aug 01 16:40:29.800835 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Id: 7a310f36f74e4eaabd9f32220feb274a Aug 01 16:40:29.800835 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Name: tempest-DeleteServersTestJSON-688058315-project Aug 01 16:40:29.800835 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: method: > Aug 01 16:40:29.800835 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: exception: Instance 97a3e151-77b3-424a-9e0c-8fd838b8fe23 could not be found. Aug 01 16:40:29.800835 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: action_args: {'id': '97a3e151-77b3-424a-9e0c-8fd838b8fe23'} Aug 01 16:40:29.801526 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:40:29.801526 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:40:29.801526 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 16:40:29.801526 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 16:40:29.801526 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 16:40:29.801526 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 16:40:29.801526 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 16:40:29.801526 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 16:40:29.801526 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 16:40:29.801526 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 16:40:29.801526 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97a3e151-77b3-424a-9e0c-8fd838b8fe23 could not be found. Aug 01 16:40:29.801526 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:40:29.801526 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:40:29.801526 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:40:29.801526 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:40:29.801526 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:40:29.801526 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:40:29.801526 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:40:29.801526 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:40:29.801526 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:40:29.802604 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:40:29.802604 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 16:40:29.802604 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 16:40:29.802604 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 16:40:29.802604 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 16:40:29.802604 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 16:40:29.802604 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:40:29.802604 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97a3e151-77b3-424a-9e0c-8fd838b8fe23 could not be found. Aug 01 16:40:29.802604 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:40:29.802604 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:40:29.802604 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:40:29.802604 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:40:29.802604 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:40:29.802604 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:40:29.802604 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:40:29.802604 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:40:29.802604 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97a3e151-77b3-424a-9e0c-8fd838b8fe23 could not be found. Aug 01 16:40:29.802604 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:40:29.813959 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-a26bd3e7-51ad-4bbe-9ca6-1db25d4e9026 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Returning 404 to user: Instance 97a3e151-77b3-424a-9e0c-8fd838b8fe23 could not be found. {{(pid=118117) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:40:29.816083 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-a26bd3e7-51ad-4bbe-9ca6-1db25d4e9026 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] 10.222.0.45 "GET /compute/v2.1/servers/97a3e151-77b3-424a-9e0c-8fd838b8fe23" status: 404 len: 111 microversion: 2.1 time: 0.069782 Aug 01 16:40:29.817060 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 71/152] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:40:29 2022] GET /compute/v2.1/servers/97a3e151-77b3-424a-9e0c-8fd838b8fe23 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 16:40:30.006167 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-8aaf3ce9-440d-406b-82c4-d25524d4f2f0 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:30.007588 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-8aaf3ce9-440d-406b-82c4-d25524d4f2f0 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:30.020137 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-8aaf3ce9-440d-406b-82c4-d25524d4f2f0 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:30.022239 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-8aaf3ce9-440d-406b-82c4-d25524d4f2f0 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:30.023698 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-8aaf3ce9-440d-406b-82c4-d25524d4f2f0 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:30.025649 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-8aaf3ce9-440d-406b-82c4-d25524d4f2f0 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:30.138156 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-63592a52-539c-40bc-99b7-9ba432728c4d tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:30.141122 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-63592a52-539c-40bc-99b7-9ba432728c4d tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] [instance: 97a3e151-77b3-424a-9e0c-8fd838b8fe23] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:30.149579 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-63592a52-539c-40bc-99b7-9ba432728c4d tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:30.150372 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-63592a52-539c-40bc-99b7-9ba432728c4d tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:30.151184 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-63592a52-539c-40bc-99b7-9ba432728c4d tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:30.151808 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-63592a52-539c-40bc-99b7-9ba432728c4d tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:30.171426 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_cell1:SELECT=100 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:30.173546 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.wsgi [None req-63592a52-539c-40bc-99b7-9ba432728c4d tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] HTTP exception thrown: Instance 97a3e151-77b3-424a-9e0c-8fd838b8fe23 could not be found. Aug 01 16:40:30.177152 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-63592a52-539c-40bc-99b7-9ba432728c4d tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Request method failure captured: Aug 01 16:40:30.177152 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: request: GET /compute/v2.1/servers/97a3e151-77b3-424a-9e0c-8fd838b8fe23/os-volume_attachments HTTP/1.1 Aug 01 16:40:30.177152 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Accept: application/json Aug 01 16:40:30.177152 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Accept-Encoding: identity Aug 01 16:40:30.177152 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Connection: close Aug 01 16:40:30.177152 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Content-Length: 0 Aug 01 16:40:30.177152 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Content-Type: application/json Aug 01 16:40:30.177152 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Host: 10.222.0.45 Aug 01 16:40:30.177152 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Openstack-System-Scope: None Aug 01 16:40:30.177152 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: User-Agent: python-urllib3/1.26.10 Aug 01 16:40:30.177152 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Auth-Token: gAAAAABi6AGuHkwhAgUw-Y7eMxR77eU7phfAxT387BOdo6eU3nzkDeFbZcDWUvScZ66IrImiTusmRI19kWz-1vSQVcRPf32tauWrDWfjgdo5hCuANFTByDpxTsipK0blVm6A9K8GhzUO0I9NQQiQzIuQBPdabYcAxwrRyQDn7NLjZdD9quzuB9A Aug 01 16:40:30.177152 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Domain-Id: None Aug 01 16:40:30.177152 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Domain-Name: None Aug 01 16:40:30.177152 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Identity-Status: Confirmed Aug 01 16:40:30.177152 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Is-Admin-Project: True Aug 01 16:40:30.177152 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Domain-Id: default Aug 01 16:40:30.177152 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Domain-Name: Default Aug 01 16:40:30.177152 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Id: c6d1d41a90df4eb8ae7b9a3934629614 Aug 01 16:40:30.177152 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Name: tempest-DeleteServersTestJSON-688058315 Aug 01 16:40:30.177152 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Role: reader,member Aug 01 16:40:30.177152 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Roles: reader,member Aug 01 16:40:30.178489 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c6d1d41a90df4eb8ae7b9a3934629614"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c6d1d41a90df4eb8ae7b9a3934629614"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c6d1d41a90df4eb8ae7b9a3934629614"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c6d1d41a90df4eb8ae7b9a3934629614"}]}] Aug 01 16:40:30.178489 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Tenant: tempest-DeleteServersTestJSON-688058315 Aug 01 16:40:30.178489 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Tenant-Id: c6d1d41a90df4eb8ae7b9a3934629614 Aug 01 16:40:30.178489 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Tenant-Name: tempest-DeleteServersTestJSON-688058315 Aug 01 16:40:30.178489 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User: tempest-DeleteServersTestJSON-688058315-project Aug 01 16:40:30.178489 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Domain-Id: default Aug 01 16:40:30.178489 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Domain-Name: Default Aug 01 16:40:30.178489 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Id: 7a310f36f74e4eaabd9f32220feb274a Aug 01 16:40:30.178489 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Name: tempest-DeleteServersTestJSON-688058315-project Aug 01 16:40:30.178489 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: method: > Aug 01 16:40:30.178489 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: exception: Instance 97a3e151-77b3-424a-9e0c-8fd838b8fe23 could not be found. Aug 01 16:40:30.178489 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: action_args: {'server_id': '97a3e151-77b3-424a-9e0c-8fd838b8fe23'} Aug 01 16:40:30.179145 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:40:30.179145 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:40:30.179145 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 16:40:30.179145 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 16:40:30.179145 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 16:40:30.179145 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 16:40:30.179145 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 16:40:30.179145 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 16:40:30.179145 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 16:40:30.179145 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 16:40:30.179145 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97a3e151-77b3-424a-9e0c-8fd838b8fe23 could not be found. Aug 01 16:40:30.179145 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:40:30.179145 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:40:30.179145 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:40:30.179145 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:40:30.179145 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:40:30.179145 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:40:30.179145 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:40:30.179145 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:40:30.179145 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:40:30.180243 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:40:30.180243 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 01 16:40:30.180243 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 16:40:30.180243 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 01 16:40:30.180243 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 16:40:30.180243 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 01 16:40:30.180243 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 01 16:40:30.180243 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 16:40:30.180243 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:40:30.180243 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97a3e151-77b3-424a-9e0c-8fd838b8fe23 could not be found. Aug 01 16:40:30.180243 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:40:30.180243 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:40:30.180243 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:40:30.180243 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:40:30.180243 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:40:30.180243 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:40:30.180243 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:40:30.180243 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:40:30.180243 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97a3e151-77b3-424a-9e0c-8fd838b8fe23 could not be found. Aug 01 16:40:30.180243 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:40:30.182948 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-63592a52-539c-40bc-99b7-9ba432728c4d tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Returning 404 to user: Instance 97a3e151-77b3-424a-9e0c-8fd838b8fe23 could not be found. {{(pid=118117) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:40:30.184141 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-63592a52-539c-40bc-99b7-9ba432728c4d tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] 10.222.0.45 "GET /compute/v2.1/servers/97a3e151-77b3-424a-9e0c-8fd838b8fe23/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.050790 Aug 01 16:40:30.185305 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 72/153] 10.222.0.45 () {58 vars in 1302 bytes} [Mon Aug 1 16:40:30 2022] GET /compute/v2.1/servers/97a3e151-77b3-424a-9e0c-8fd838b8fe23/os-volume_attachments => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 16:40:30.367435 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-8aaf3ce9-440d-406b-82c4-d25524d4f2f0 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:30.385126 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-8aaf3ce9-440d-406b-82c4-d25524d4f2f0 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7" status: 200 len: 1522 microversion: 2.1 time: 0.384834 Aug 01 16:40:30.387243 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 82/154] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:40:29 2022] GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7 => generated 1522 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:40:31.410958 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-8e799888-bb32-4182-a6d1-8099635e16b6 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:31.411775 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-8e799888-bb32-4182-a6d1-8099635e16b6 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:31.421000 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-8e799888-bb32-4182-a6d1-8099635e16b6 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:31.421849 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-8e799888-bb32-4182-a6d1-8099635e16b6 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:31.422651 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-8e799888-bb32-4182-a6d1-8099635e16b6 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:31.423741 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-8e799888-bb32-4182-a6d1-8099635e16b6 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:31.584888 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-3eb19638-c4d3-4f43-b510-2512802dc823 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:31.587918 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-3eb19638-c4d3-4f43-b510-2512802dc823 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] [instance: 97a3e151-77b3-424a-9e0c-8fd838b8fe23] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:31.629445 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3eb19638-c4d3-4f43-b510-2512802dc823 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:31.635148 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3eb19638-c4d3-4f43-b510-2512802dc823 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:31.648077 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3eb19638-c4d3-4f43-b510-2512802dc823 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:31.654629 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3eb19638-c4d3-4f43-b510-2512802dc823 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:31.737968 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.wsgi [None req-3eb19638-c4d3-4f43-b510-2512802dc823 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] HTTP exception thrown: Instance 97a3e151-77b3-424a-9e0c-8fd838b8fe23 could not be found. Aug 01 16:40:31.763903 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-3eb19638-c4d3-4f43-b510-2512802dc823 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Request method failure captured: Aug 01 16:40:31.763903 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: request: DELETE /compute/v2.1/servers/97a3e151-77b3-424a-9e0c-8fd838b8fe23 HTTP/1.1 Aug 01 16:40:31.763903 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Accept: application/json Aug 01 16:40:31.763903 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Accept-Encoding: identity Aug 01 16:40:31.763903 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Connection: close Aug 01 16:40:31.763903 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Content-Length: 0 Aug 01 16:40:31.763903 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Content-Type: application/json Aug 01 16:40:31.763903 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Host: 10.222.0.45 Aug 01 16:40:31.763903 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Openstack-System-Scope: None Aug 01 16:40:31.763903 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: User-Agent: python-urllib3/1.26.10 Aug 01 16:40:31.763903 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Auth-Token: gAAAAABi6AGuHkwhAgUw-Y7eMxR77eU7phfAxT387BOdo6eU3nzkDeFbZcDWUvScZ66IrImiTusmRI19kWz-1vSQVcRPf32tauWrDWfjgdo5hCuANFTByDpxTsipK0blVm6A9K8GhzUO0I9NQQiQzIuQBPdabYcAxwrRyQDn7NLjZdD9quzuB9A Aug 01 16:40:31.763903 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Domain-Id: None Aug 01 16:40:31.763903 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Domain-Name: None Aug 01 16:40:31.763903 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Identity-Status: Confirmed Aug 01 16:40:31.763903 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Is-Admin-Project: True Aug 01 16:40:31.763903 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Domain-Id: default Aug 01 16:40:31.763903 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Domain-Name: Default Aug 01 16:40:31.763903 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Id: c6d1d41a90df4eb8ae7b9a3934629614 Aug 01 16:40:31.763903 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Name: tempest-DeleteServersTestJSON-688058315 Aug 01 16:40:31.763903 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Role: reader,member Aug 01 16:40:31.763903 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Roles: reader,member Aug 01 16:40:31.765155 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c6d1d41a90df4eb8ae7b9a3934629614"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c6d1d41a90df4eb8ae7b9a3934629614"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c6d1d41a90df4eb8ae7b9a3934629614"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c6d1d41a90df4eb8ae7b9a3934629614"}]}] Aug 01 16:40:31.765155 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant: tempest-DeleteServersTestJSON-688058315 Aug 01 16:40:31.765155 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant-Id: c6d1d41a90df4eb8ae7b9a3934629614 Aug 01 16:40:31.765155 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant-Name: tempest-DeleteServersTestJSON-688058315 Aug 01 16:40:31.765155 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User: tempest-DeleteServersTestJSON-688058315-project Aug 01 16:40:31.765155 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Domain-Id: default Aug 01 16:40:31.765155 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Domain-Name: Default Aug 01 16:40:31.765155 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Id: 7a310f36f74e4eaabd9f32220feb274a Aug 01 16:40:31.765155 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Name: tempest-DeleteServersTestJSON-688058315-project Aug 01 16:40:31.765155 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: method: > Aug 01 16:40:31.765155 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: exception: Instance 97a3e151-77b3-424a-9e0c-8fd838b8fe23 could not be found. Aug 01 16:40:31.765155 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: action_args: {'id': '97a3e151-77b3-424a-9e0c-8fd838b8fe23'} Aug 01 16:40:31.765944 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:40:31.765944 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:40:31.765944 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 16:40:31.765944 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 16:40:31.765944 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 16:40:31.765944 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 16:40:31.765944 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 16:40:31.765944 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 16:40:31.765944 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 16:40:31.765944 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 16:40:31.765944 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97a3e151-77b3-424a-9e0c-8fd838b8fe23 could not be found. Aug 01 16:40:31.765944 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:40:31.765944 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:40:31.765944 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:40:31.765944 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:40:31.765944 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:40:31.765944 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:40:31.765944 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:40:31.765944 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:40:31.765944 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:40:31.767684 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:40:31.767684 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 16:40:31.767684 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 16:40:31.767684 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 16:40:31.767684 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 16:40:31.767684 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 16:40:31.767684 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 16:40:31.767684 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 16:40:31.767684 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:40:31.767684 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97a3e151-77b3-424a-9e0c-8fd838b8fe23 could not be found. Aug 01 16:40:31.767684 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:40:31.767684 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:40:31.767684 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:40:31.767684 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:40:31.767684 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:40:31.767684 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:40:31.767684 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:40:31.767684 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:40:31.767684 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97a3e151-77b3-424a-9e0c-8fd838b8fe23 could not be found. Aug 01 16:40:31.767684 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:40:31.770021 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-3eb19638-c4d3-4f43-b510-2512802dc823 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Returning 404 to user: Instance 97a3e151-77b3-424a-9e0c-8fd838b8fe23 could not be found. {{(pid=118118) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:40:31.772834 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-3eb19638-c4d3-4f43-b510-2512802dc823 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] 10.222.0.45 "DELETE /compute/v2.1/servers/97a3e151-77b3-424a-9e0c-8fd838b8fe23" status: 404 len: 111 microversion: 2.1 time: 0.195261 Aug 01 16:40:31.780217 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 83/155] 10.222.0.45 () {58 vars in 1239 bytes} [Mon Aug 1 16:40:31 2022] DELETE /compute/v2.1/servers/97a3e151-77b3-424a-9e0c-8fd838b8fe23 => generated 111 bytes in 206 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 16:40:31.787272 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-8e799888-bb32-4182-a6d1-8099635e16b6 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:31.804656 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-8e799888-bb32-4182-a6d1-8099635e16b6 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7" status: 200 len: 1522 microversion: 2.1 time: 0.401115 Aug 01 16:40:31.808308 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-dbfd506e-1e0d-4e38-be2c-f48f13f23028 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:31.809361 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-dbfd506e-1e0d-4e38-be2c-f48f13f23028 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] [instance: 97a3e151-77b3-424a-9e0c-8fd838b8fe23] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:31.816447 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 73/156] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:40:31 2022] GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7 => generated 1522 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:40:31.836904 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-dbfd506e-1e0d-4e38-be2c-f48f13f23028 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:31.837455 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-dbfd506e-1e0d-4e38-be2c-f48f13f23028 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:31.838326 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-dbfd506e-1e0d-4e38-be2c-f48f13f23028 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:31.839908 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-dbfd506e-1e0d-4e38-be2c-f48f13f23028 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:31.883863 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.wsgi [None req-dbfd506e-1e0d-4e38-be2c-f48f13f23028 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] HTTP exception thrown: Instance 97a3e151-77b3-424a-9e0c-8fd838b8fe23 could not be found. Aug 01 16:40:31.886869 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-dbfd506e-1e0d-4e38-be2c-f48f13f23028 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Request method failure captured: Aug 01 16:40:31.886869 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: request: GET /compute/v2.1/servers/97a3e151-77b3-424a-9e0c-8fd838b8fe23 HTTP/1.1 Aug 01 16:40:31.886869 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Accept: application/json Aug 01 16:40:31.886869 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Accept-Encoding: identity Aug 01 16:40:31.886869 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Connection: close Aug 01 16:40:31.886869 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Content-Length: 0 Aug 01 16:40:31.886869 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Content-Type: application/json Aug 01 16:40:31.886869 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Host: 10.222.0.45 Aug 01 16:40:31.886869 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Openstack-System-Scope: None Aug 01 16:40:31.886869 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: User-Agent: python-urllib3/1.26.10 Aug 01 16:40:31.886869 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Auth-Token: gAAAAABi6AGuHkwhAgUw-Y7eMxR77eU7phfAxT387BOdo6eU3nzkDeFbZcDWUvScZ66IrImiTusmRI19kWz-1vSQVcRPf32tauWrDWfjgdo5hCuANFTByDpxTsipK0blVm6A9K8GhzUO0I9NQQiQzIuQBPdabYcAxwrRyQDn7NLjZdD9quzuB9A Aug 01 16:40:31.886869 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Domain-Id: None Aug 01 16:40:31.886869 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Domain-Name: None Aug 01 16:40:31.886869 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Identity-Status: Confirmed Aug 01 16:40:31.886869 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Is-Admin-Project: True Aug 01 16:40:31.886869 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Domain-Id: default Aug 01 16:40:31.886869 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Domain-Name: Default Aug 01 16:40:31.886869 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Id: c6d1d41a90df4eb8ae7b9a3934629614 Aug 01 16:40:31.886869 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Name: tempest-DeleteServersTestJSON-688058315 Aug 01 16:40:31.886869 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Role: reader,member Aug 01 16:40:31.886869 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Roles: reader,member Aug 01 16:40:31.889108 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c6d1d41a90df4eb8ae7b9a3934629614"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c6d1d41a90df4eb8ae7b9a3934629614"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c6d1d41a90df4eb8ae7b9a3934629614"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c6d1d41a90df4eb8ae7b9a3934629614"}]}] Aug 01 16:40:31.889108 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant: tempest-DeleteServersTestJSON-688058315 Aug 01 16:40:31.889108 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant-Id: c6d1d41a90df4eb8ae7b9a3934629614 Aug 01 16:40:31.889108 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant-Name: tempest-DeleteServersTestJSON-688058315 Aug 01 16:40:31.889108 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User: tempest-DeleteServersTestJSON-688058315-project Aug 01 16:40:31.889108 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Domain-Id: default Aug 01 16:40:31.889108 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Domain-Name: Default Aug 01 16:40:31.889108 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Id: 7a310f36f74e4eaabd9f32220feb274a Aug 01 16:40:31.889108 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Name: tempest-DeleteServersTestJSON-688058315-project Aug 01 16:40:31.889108 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: method: > Aug 01 16:40:31.889108 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: exception: Instance 97a3e151-77b3-424a-9e0c-8fd838b8fe23 could not be found. Aug 01 16:40:31.889108 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: action_args: {'id': '97a3e151-77b3-424a-9e0c-8fd838b8fe23'} Aug 01 16:40:31.890731 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:40:31.890731 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:40:31.890731 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 16:40:31.890731 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 16:40:31.890731 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 16:40:31.890731 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 16:40:31.890731 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 16:40:31.890731 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 16:40:31.890731 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 16:40:31.890731 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 16:40:31.890731 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97a3e151-77b3-424a-9e0c-8fd838b8fe23 could not be found. Aug 01 16:40:31.890731 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:40:31.890731 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:40:31.890731 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:40:31.890731 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:40:31.890731 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:40:31.890731 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:40:31.890731 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:40:31.890731 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:40:31.890731 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:40:31.892991 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:40:31.892991 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 16:40:31.892991 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 16:40:31.892991 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 16:40:31.892991 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 16:40:31.892991 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 16:40:31.892991 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:40:31.892991 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97a3e151-77b3-424a-9e0c-8fd838b8fe23 could not be found. Aug 01 16:40:31.892991 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:40:31.892991 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:40:31.892991 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:40:31.892991 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:40:31.892991 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:40:31.892991 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:40:31.892991 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:40:31.892991 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:40:31.892991 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97a3e151-77b3-424a-9e0c-8fd838b8fe23 could not be found. Aug 01 16:40:31.892991 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:40:31.898795 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-dbfd506e-1e0d-4e38-be2c-f48f13f23028 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] Returning 404 to user: Instance 97a3e151-77b3-424a-9e0c-8fd838b8fe23 could not be found. {{(pid=118118) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:40:31.903080 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-dbfd506e-1e0d-4e38-be2c-f48f13f23028 tempest-DeleteServersTestJSON-688058315 tempest-DeleteServersTestJSON-688058315-project] 10.222.0.45 "GET /compute/v2.1/servers/97a3e151-77b3-424a-9e0c-8fd838b8fe23" status: 404 len: 111 microversion: 2.1 time: 0.107952 Aug 01 16:40:31.911065 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 84/157] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:40:31 2022] GET /compute/v2.1/servers/97a3e151-77b3-424a-9e0c-8fd838b8fe23 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 16:40:32.829780 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-7d7274d4-36fe-4056-948e-9c87b818f33e tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:32.831494 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-7d7274d4-36fe-4056-948e-9c87b818f33e tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:32.839640 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-7d7274d4-36fe-4056-948e-9c87b818f33e tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:32.840525 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-7d7274d4-36fe-4056-948e-9c87b818f33e tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:32.841650 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-7d7274d4-36fe-4056-948e-9c87b818f33e tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:32.842373 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-7d7274d4-36fe-4056-948e-9c87b818f33e tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:33.250709 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-7d7274d4-36fe-4056-948e-9c87b818f33e tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:33.267394 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-7d7274d4-36fe-4056-948e-9c87b818f33e tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7" status: 200 len: 1522 microversion: 2.1 time: 0.442043 Aug 01 16:40:33.285092 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 74/158] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:40:32 2022] GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7 => generated 1522 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:40:34.308920 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-3fec062c-c0bb-4c47-9684-45a03ff638b5 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:34.310203 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-3fec062c-c0bb-4c47-9684-45a03ff638b5 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:34.317399 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3fec062c-c0bb-4c47-9684-45a03ff638b5 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:34.318104 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3fec062c-c0bb-4c47-9684-45a03ff638b5 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:34.318893 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3fec062c-c0bb-4c47-9684-45a03ff638b5 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:34.319338 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3fec062c-c0bb-4c47-9684-45a03ff638b5 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:34.752181 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-3fec062c-c0bb-4c47-9684-45a03ff638b5 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:34.768939 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-3fec062c-c0bb-4c47-9684-45a03ff638b5 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7" status: 200 len: 1522 microversion: 2.1 time: 0.463749 Aug 01 16:40:34.779655 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 85/159] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:40:34 2022] GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7 => generated 1522 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:40:35.798696 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-bcac9671-5b06-46e6-a66e-fa1345c93141 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:35.800408 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-bcac9671-5b06-46e6-a66e-fa1345c93141 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:35.828512 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_api:SELECT=56 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:35.847901 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-bcac9671-5b06-46e6-a66e-fa1345c93141 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:35.851792 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-bcac9671-5b06-46e6-a66e-fa1345c93141 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:35.859317 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-bcac9671-5b06-46e6-a66e-fa1345c93141 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:35.860886 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-bcac9671-5b06-46e6-a66e-fa1345c93141 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:36.648778 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-bcac9671-5b06-46e6-a66e-fa1345c93141 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:36.688422 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-bcac9671-5b06-46e6-a66e-fa1345c93141 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7" status: 200 len: 1522 microversion: 2.1 time: 0.897716 Aug 01 16:40:36.697372 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 75/160] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:40:35 2022] GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7 => generated 1522 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:40:37.728942 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-148e0e76-3fcf-477c-a4c5-bba618837ef2 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:37.731081 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-148e0e76-3fcf-477c-a4c5-bba618837ef2 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:37.749734 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-148e0e76-3fcf-477c-a4c5-bba618837ef2 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:37.750292 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-148e0e76-3fcf-477c-a4c5-bba618837ef2 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:37.757459 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-148e0e76-3fcf-477c-a4c5-bba618837ef2 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:37.758095 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-148e0e76-3fcf-477c-a4c5-bba618837ef2 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:38.152074 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-148e0e76-3fcf-477c-a4c5-bba618837ef2 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:38.166163 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-148e0e76-3fcf-477c-a4c5-bba618837ef2 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7" status: 200 len: 1522 microversion: 2.1 time: 0.441526 Aug 01 16:40:38.183978 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 86/161] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:40:37 2022] GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7 => generated 1522 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:40:39.199291 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-4f43384a-2ef7-4097-92b2-6ca6330bd31a tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:39.201102 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-4f43384a-2ef7-4097-92b2-6ca6330bd31a tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:39.224596 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-4f43384a-2ef7-4097-92b2-6ca6330bd31a tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:39.226452 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-4f43384a-2ef7-4097-92b2-6ca6330bd31a tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:39.227543 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-4f43384a-2ef7-4097-92b2-6ca6330bd31a tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:39.228718 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-4f43384a-2ef7-4097-92b2-6ca6330bd31a tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:39.841027 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-4f43384a-2ef7-4097-92b2-6ca6330bd31a tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:39.850021 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-4f43384a-2ef7-4097-92b2-6ca6330bd31a tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7" status: 200 len: 1522 microversion: 2.1 time: 0.657574 Aug 01 16:40:39.854599 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 76/162] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:40:39 2022] GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7 => generated 1522 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:40:40.900510 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-70f6c203-8343-4446-902e-dda4c60f2868 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:40.902359 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-70f6c203-8343-4446-902e-dda4c60f2868 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:40.916713 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-70f6c203-8343-4446-902e-dda4c60f2868 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:40.918384 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-70f6c203-8343-4446-902e-dda4c60f2868 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:40.920684 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-70f6c203-8343-4446-902e-dda4c60f2868 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:40.922314 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-70f6c203-8343-4446-902e-dda4c60f2868 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:40.972361 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:41.213148 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-70f6c203-8343-4446-902e-dda4c60f2868 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:41.228624 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-70f6c203-8343-4446-902e-dda4c60f2868 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7" status: 200 len: 1522 microversion: 2.1 time: 0.331739 Aug 01 16:40:41.232072 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 87/163] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:40:40 2022] GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7 => generated 1522 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:40:42.273251 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-e0fc21bf-8f5d-4053-9542-37a31ba0c49f tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:42.273877 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-e0fc21bf-8f5d-4053-9542-37a31ba0c49f tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:42.281376 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-e0fc21bf-8f5d-4053-9542-37a31ba0c49f tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:42.281821 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-e0fc21bf-8f5d-4053-9542-37a31ba0c49f tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:42.285504 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-e0fc21bf-8f5d-4053-9542-37a31ba0c49f tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:42.285937 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-e0fc21bf-8f5d-4053-9542-37a31ba0c49f tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:42.520997 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-e0fc21bf-8f5d-4053-9542-37a31ba0c49f tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:42.536636 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-e0fc21bf-8f5d-4053-9542-37a31ba0c49f tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7" status: 200 len: 1522 microversion: 2.1 time: 0.267335 Aug 01 16:40:42.552552 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 77/164] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:40:42 2022] GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7 => generated 1522 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:40:43.574643 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-dab264d8-202e-4534-9857-14961f813ace tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:43.575917 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-dab264d8-202e-4534-9857-14961f813ace tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:43.593034 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-dab264d8-202e-4534-9857-14961f813ace tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:43.593945 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-dab264d8-202e-4534-9857-14961f813ace tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:43.595103 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-dab264d8-202e-4534-9857-14961f813ace tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:43.597158 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-dab264d8-202e-4534-9857-14961f813ace tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:44.115884 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-dab264d8-202e-4534-9857-14961f813ace tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:44.134621 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-dab264d8-202e-4534-9857-14961f813ace tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7" status: 200 len: 1522 microversion: 2.1 time: 0.566578 Aug 01 16:40:44.135569 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 88/165] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:40:43 2022] GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7 => generated 1522 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:40:45.172681 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-4e2aefa6-4bbd-411d-862f-c631ff402fa4 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:45.173947 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-4e2aefa6-4bbd-411d-862f-c631ff402fa4 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:45.182028 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-4e2aefa6-4bbd-411d-862f-c631ff402fa4 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:45.182869 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-4e2aefa6-4bbd-411d-862f-c631ff402fa4 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:45.184165 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-4e2aefa6-4bbd-411d-862f-c631ff402fa4 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:45.184822 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-4e2aefa6-4bbd-411d-862f-c631ff402fa4 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:45.381806 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-4e2aefa6-4bbd-411d-862f-c631ff402fa4 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:45.391002 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-4e2aefa6-4bbd-411d-862f-c631ff402fa4 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7" status: 200 len: 1522 microversion: 2.1 time: 0.224262 Aug 01 16:40:45.392760 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 78/166] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:40:45 2022] GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7 => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:40:45.893400 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-310f5eb5-9739-4242-99cc-30fb9b8f799e tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-737985710", "imageRef": "c9cb5329-85cb-4472-935d-c4ea1d1f0592", "flavorRef": "452"}} {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:40:45.904825 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:45.972036 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.network.neutron [None req-310f5eb5-9739-4242-99cc-30fb9b8f799e tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] validate_networks() for None {{(pid=118118) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 16:40:46.421826 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-6e38f533-fe4f-4632-845a-8b364852e92b tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:46.424036 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-6e38f533-fe4f-4632-845a-8b364852e92b tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:46.432624 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-6e38f533-fe4f-4632-845a-8b364852e92b tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:46.433426 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-6e38f533-fe4f-4632-845a-8b364852e92b tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:46.434630 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-6e38f533-fe4f-4632-845a-8b364852e92b tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:46.435244 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-6e38f533-fe4f-4632-845a-8b364852e92b tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:46.698949 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.virt.hardware [None req-310f5eb5-9739-4242-99cc-30fb9b8f799e tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Flavor limits 0:0:0 {{(pid=118118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 16:40:46.699622 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.virt.hardware [None req-310f5eb5-9739-4242-99cc-30fb9b8f799e tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Image limits 0:0:0 {{(pid=118118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 16:40:46.700199 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.virt.hardware [None req-310f5eb5-9739-4242-99cc-30fb9b8f799e tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Flavor pref 0:0:0 {{(pid=118118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 16:40:46.700663 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.virt.hardware [None req-310f5eb5-9739-4242-99cc-30fb9b8f799e tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Image pref 0:0:0 {{(pid=118118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 16:40:46.701252 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.virt.hardware [None req-310f5eb5-9739-4242-99cc-30fb9b8f799e tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 16:40:46.711240 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-310f5eb5-9739-4242-99cc-30fb9b8f799e tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:46.712078 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-310f5eb5-9739-4242-99cc-30fb9b8f799e tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:46.713128 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-310f5eb5-9739-4242-99cc-30fb9b8f799e tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:46.713783 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-310f5eb5-9739-4242-99cc-30fb9b8f799e tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:46.747986 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.quota [None req-310f5eb5-9739-4242-99cc-30fb9b8f799e tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Getting quotas for project c31add21e55d4704b8285a700af04410. Resources: {'cores', 'ram', 'instances'} {{(pid=118118) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 16:40:46.751290 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-6e38f533-fe4f-4632-845a-8b364852e92b tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:46.753680 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.quota [None req-310f5eb5-9739-4242-99cc-30fb9b8f799e tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Getting quotas for user c4c08c97c2fb446ba2d363c8a18d4958 and project c31add21e55d4704b8285a700af04410. Resources: {'cores', 'ram', 'instances'} {{(pid=118118) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 16:40:46.766812 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-6e38f533-fe4f-4632-845a-8b364852e92b tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7" status: 200 len: 1522 microversion: 2.1 time: 0.351663 Aug 01 16:40:46.767675 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 79/167] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:40:46 2022] GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7 => generated 1522 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:40:46.771505 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-310f5eb5-9739-4242-99cc-30fb9b8f799e tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Going to run 1 instances... {{(pid=118118) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 16:40:46.773866 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-310f5eb5-9739-4242-99cc-30fb9b8f799e tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] [instance: 016ea7a5-9bd1-4a28-baec-19dc96fd478c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c9cb5329-85cb-4472-935d-c4ea1d1f0592',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118118) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 16:40:46.853724 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-310f5eb5-9739-4242-99cc-30fb9b8f799e tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.964835 Aug 01 16:40:46.854768 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 89/168] 10.222.0.45 () {60 vars in 1147 bytes} [Mon Aug 1 16:40:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 967 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 16:40:46.868624 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-fbc6aeaa-a189-422f-8038-5a3fd3b4013d tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:46.871878 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-fbc6aeaa-a189-422f-8038-5a3fd3b4013d tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] [instance: 016ea7a5-9bd1-4a28-baec-19dc96fd478c] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:46.965538 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-fbc6aeaa-a189-422f-8038-5a3fd3b4013d tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c08c97c2fb446ba2d363c8a18d4958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31add21e55d4704b8285a700af04410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:46.982480 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-fbc6aeaa-a189-422f-8038-5a3fd3b4013d tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] 10.222.0.45 "GET /compute/v2.1/servers/016ea7a5-9bd1-4a28-baec-19dc96fd478c" status: 200 len: 1214 microversion: 2.1 time: 0.120219 Aug 01 16:40:46.983517 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 80/169] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:40:46 2022] GET /compute/v2.1/servers/016ea7a5-9bd1-4a28-baec-19dc96fd478c => generated 1214 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:40:47.788524 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-cafca5a0-cdb0-47ca-8437-3197642de6c2 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:47.789149 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-cafca5a0-cdb0-47ca-8437-3197642de6c2 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:47.798327 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-cafca5a0-cdb0-47ca-8437-3197642de6c2 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:47.798762 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-cafca5a0-cdb0-47ca-8437-3197642de6c2 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:47.799810 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-cafca5a0-cdb0-47ca-8437-3197642de6c2 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:47.800245 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-cafca5a0-cdb0-47ca-8437-3197642de6c2 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:47.940498 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-cafca5a0-cdb0-47ca-8437-3197642de6c2 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:47.951141 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-cafca5a0-cdb0-47ca-8437-3197642de6c2 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7" status: 200 len: 1522 microversion: 2.1 time: 0.166432 Aug 01 16:40:47.951909 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 90/170] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:40:47 2022] GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:40:48.005502 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-cba72f60-208b-4c33-b66d-ec5be4329802 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:48.007214 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-cba72f60-208b-4c33-b66d-ec5be4329802 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] [instance: 016ea7a5-9bd1-4a28-baec-19dc96fd478c] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:48.014897 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-cba72f60-208b-4c33-b66d-ec5be4329802 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:48.015477 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-cba72f60-208b-4c33-b66d-ec5be4329802 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:48.016365 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-cba72f60-208b-4c33-b66d-ec5be4329802 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:48.017252 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-cba72f60-208b-4c33-b66d-ec5be4329802 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:48.094907 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-cba72f60-208b-4c33-b66d-ec5be4329802 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c08c97c2fb446ba2d363c8a18d4958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31add21e55d4704b8285a700af04410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:48.106675 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-cba72f60-208b-4c33-b66d-ec5be4329802 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] 10.222.0.45 "GET /compute/v2.1/servers/016ea7a5-9bd1-4a28-baec-19dc96fd478c" status: 200 len: 1218 microversion: 2.1 time: 0.105814 Aug 01 16:40:48.107265 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 81/171] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:40:47 2022] GET /compute/v2.1/servers/016ea7a5-9bd1-4a28-baec-19dc96fd478c => generated 1218 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:40:48.974634 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-a7de80b8-0fdb-4740-ab27-e7bc331908d3 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:48.976392 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-a7de80b8-0fdb-4740-ab27-e7bc331908d3 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:48.983582 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a7de80b8-0fdb-4740-ab27-e7bc331908d3 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:48.984376 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a7de80b8-0fdb-4740-ab27-e7bc331908d3 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:48.985368 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a7de80b8-0fdb-4740-ab27-e7bc331908d3 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:48.985952 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a7de80b8-0fdb-4740-ab27-e7bc331908d3 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:49.129215 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-d7a38567-3876-4000-b767-fc410c68d3f3 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:49.129916 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-d7a38567-3876-4000-b767-fc410c68d3f3 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] [instance: 016ea7a5-9bd1-4a28-baec-19dc96fd478c] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:49.145411 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-d7a38567-3876-4000-b767-fc410c68d3f3 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:49.145855 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-d7a38567-3876-4000-b767-fc410c68d3f3 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:49.147200 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-d7a38567-3876-4000-b767-fc410c68d3f3 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:49.147799 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-d7a38567-3876-4000-b767-fc410c68d3f3 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:49.226487 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-a7de80b8-0fdb-4740-ab27-e7bc331908d3 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:49.235465 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-a7de80b8-0fdb-4740-ab27-e7bc331908d3 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7" status: 200 len: 1522 microversion: 2.1 time: 0.266103 Aug 01 16:40:49.244063 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 91/172] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:40:48 2022] GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7 => generated 1522 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:40:49.263065 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-d7a38567-3876-4000-b767-fc410c68d3f3 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c08c97c2fb446ba2d363c8a18d4958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31add21e55d4704b8285a700af04410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:49.274918 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-d7a38567-3876-4000-b767-fc410c68d3f3 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] 10.222.0.45 "GET /compute/v2.1/servers/016ea7a5-9bd1-4a28-baec-19dc96fd478c" status: 200 len: 1210 microversion: 2.1 time: 0.147054 Aug 01 16:40:49.274918 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 82/173] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:40:49 2022] GET /compute/v2.1/servers/016ea7a5-9bd1-4a28-baec-19dc96fd478c => generated 1210 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:40:50.270444 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-939db877-fffc-46d4-ac0d-f49de06cd249 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:50.271693 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-939db877-fffc-46d4-ac0d-f49de06cd249 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:50.279531 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-939db877-fffc-46d4-ac0d-f49de06cd249 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:50.280043 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-939db877-fffc-46d4-ac0d-f49de06cd249 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:50.281249 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-939db877-fffc-46d4-ac0d-f49de06cd249 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:50.281971 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-939db877-fffc-46d4-ac0d-f49de06cd249 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:50.295956 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-e7757a6d-b4c8-43ba-9ecc-e949c825d700 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:50.296731 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-e7757a6d-b4c8-43ba-9ecc-e949c825d700 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] [instance: 016ea7a5-9bd1-4a28-baec-19dc96fd478c] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:50.314016 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-e7757a6d-b4c8-43ba-9ecc-e949c825d700 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:50.314693 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-e7757a6d-b4c8-43ba-9ecc-e949c825d700 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:50.317395 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-e7757a6d-b4c8-43ba-9ecc-e949c825d700 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:50.318290 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-e7757a6d-b4c8-43ba-9ecc-e949c825d700 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:50.469727 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-e7757a6d-b4c8-43ba-9ecc-e949c825d700 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c08c97c2fb446ba2d363c8a18d4958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31add21e55d4704b8285a700af04410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:50.481904 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-e7757a6d-b4c8-43ba-9ecc-e949c825d700 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] 10.222.0.45 "GET /compute/v2.1/servers/016ea7a5-9bd1-4a28-baec-19dc96fd478c" status: 200 len: 1272 microversion: 2.1 time: 0.190502 Aug 01 16:40:50.483351 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 83/174] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:40:50 2022] GET /compute/v2.1/servers/016ea7a5-9bd1-4a28-baec-19dc96fd478c => generated 1272 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:40:50.684118 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-939db877-fffc-46d4-ac0d-f49de06cd249 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:50.688871 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-c3f456cd-8f6a-4bfc-ade0-d64da124a66c tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Action: 'create', calling method: .version_select at 0x7efd5ede1b80>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-777072474", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKyDYVed09B6QY2XRkQyLXPUKzPAd07DNJUunEzeIghaPPYNTN9fyDwLsMXkUUKYESqf845cLge2UzZoAwb6x5aVITH8kSI31iUQ86pQ/s8CL2b36aO+ObZZvU63m/TL2A=="}} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:40:50.712849 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-939db877-fffc-46d4-ac0d-f49de06cd249 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7" status: 200 len: 1522 microversion: 2.1 time: 0.447517 Aug 01 16:40:50.713490 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 92/175] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:40:50 2022] GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7 => generated 1522 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:40:50.731831 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.quota [None req-c3f456cd-8f6a-4bfc-ade0-d64da124a66c tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Getting quotas for project 019734069da44b2d88561549bd07544d. Resources: {'key_pairs'} {{(pid=118117) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 16:40:50.736546 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.quota [None req-c3f456cd-8f6a-4bfc-ade0-d64da124a66c tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Getting quotas for user 23a95d9f48c64b0fbb8879d361bc177d and project 019734069da44b2d88561549bd07544d. Resources: {'key_pairs'} {{(pid=118117) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 16:40:50.765158 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-c3f456cd-8f6a-4bfc-ade0-d64da124a66c tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.091883 Aug 01 16:40:50.766788 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 84/176] 10.222.0.45 () {60 vars in 1159 bytes} [Mon Aug 1 16:40:50 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 16:40:50.916012 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-8beb85bd-cd4d-49d4-8d0d-69dfd0d53687 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1735190118", "imageRef": "0a9860b1-ccab-4a1d-a20e-1f423b82bae6", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-777072474", "networks": [{"uuid": "135999bd-92b5-4d2f-bc6f-be3f79db692e"}]}} {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:40:50.976927 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.network.neutron [None req-8beb85bd-cd4d-49d4-8d0d-69dfd0d53687 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] validate_networks() for [('135999bd-92b5-4d2f-bc6f-be3f79db692e', None, None, None, None, None)] {{(pid=118118) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 16:40:51.513139 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-60d73f34-5474-48d5-b0cd-d35e4d167ed7 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:51.514591 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-60d73f34-5474-48d5-b0cd-d35e4d167ed7 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] [instance: 016ea7a5-9bd1-4a28-baec-19dc96fd478c] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:51.530894 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-60d73f34-5474-48d5-b0cd-d35e4d167ed7 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:51.531619 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-60d73f34-5474-48d5-b0cd-d35e4d167ed7 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:51.532955 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-60d73f34-5474-48d5-b0cd-d35e4d167ed7 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:51.533873 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-60d73f34-5474-48d5-b0cd-d35e4d167ed7 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:51.884977 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.virt.hardware [None req-8beb85bd-cd4d-49d4-8d0d-69dfd0d53687 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Flavor limits 0:0:0 {{(pid=118118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 16:40:51.885456 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.virt.hardware [None req-8beb85bd-cd4d-49d4-8d0d-69dfd0d53687 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Image limits 0:0:0 {{(pid=118118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 16:40:51.885857 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.virt.hardware [None req-8beb85bd-cd4d-49d4-8d0d-69dfd0d53687 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Flavor pref 0:0:0 {{(pid=118118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 16:40:51.887157 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.virt.hardware [None req-8beb85bd-cd4d-49d4-8d0d-69dfd0d53687 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Image pref 0:0:0 {{(pid=118118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 16:40:51.887621 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.virt.hardware [None req-8beb85bd-cd4d-49d4-8d0d-69dfd0d53687 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 16:40:51.900950 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-8beb85bd-cd4d-49d4-8d0d-69dfd0d53687 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:51.901402 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-8beb85bd-cd4d-49d4-8d0d-69dfd0d53687 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:51.902215 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-8beb85bd-cd4d-49d4-8d0d-69dfd0d53687 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:51.902653 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-8beb85bd-cd4d-49d4-8d0d-69dfd0d53687 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:51.905054 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-60d73f34-5474-48d5-b0cd-d35e4d167ed7 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c08c97c2fb446ba2d363c8a18d4958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31add21e55d4704b8285a700af04410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:51.917380 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-60d73f34-5474-48d5-b0cd-d35e4d167ed7 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] 10.222.0.45 "GET /compute/v2.1/servers/016ea7a5-9bd1-4a28-baec-19dc96fd478c" status: 200 len: 1314 microversion: 2.1 time: 0.411881 Aug 01 16:40:51.919786 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 85/177] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:40:51 2022] GET /compute/v2.1/servers/016ea7a5-9bd1-4a28-baec-19dc96fd478c => generated 1314 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:40:51.926218 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-ba19f9c4-e5f6-447b-96c3-8408ccb2725e tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:51.927182 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-ba19f9c4-e5f6-447b-96c3-8408ccb2725e tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:51.931707 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.quota [None req-8beb85bd-cd4d-49d4-8d0d-69dfd0d53687 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Getting quotas for project 019734069da44b2d88561549bd07544d. Resources: {'cores', 'ram', 'instances'} {{(pid=118118) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 16:40:51.938176 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-ba19f9c4-e5f6-447b-96c3-8408ccb2725e tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:51.938441 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-ba19f9c4-e5f6-447b-96c3-8408ccb2725e tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:51.938584 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.quota [None req-8beb85bd-cd4d-49d4-8d0d-69dfd0d53687 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Getting quotas for user 23a95d9f48c64b0fbb8879d361bc177d and project 019734069da44b2d88561549bd07544d. Resources: {'cores', 'ram', 'instances'} {{(pid=118118) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 16:40:51.939692 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-ba19f9c4-e5f6-447b-96c3-8408ccb2725e tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:51.940880 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-ba19f9c4-e5f6-447b-96c3-8408ccb2725e tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:51.958810 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-8beb85bd-cd4d-49d4-8d0d-69dfd0d53687 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Going to run 1 instances... {{(pid=118118) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 16:40:51.961501 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-8beb85bd-cd4d-49d4-8d0d-69dfd0d53687 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] [instance: 348b2621-1bf9-431b-b639-9aabbf68a3cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0a9860b1-ccab-4a1d-a20e-1f423b82bae6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118118) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 16:40:52.021728 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-8beb85bd-cd4d-49d4-8d0d-69dfd0d53687 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.111176 Aug 01 16:40:52.022381 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 93/178] 10.222.0.45 () {60 vars in 1147 bytes} [Mon Aug 1 16:40:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1113 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 01 16:40:52.033856 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-ed29aeeb-fc27-4ce4-ab83-3c4f9b75c5eb tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:52.035168 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-ed29aeeb-fc27-4ce4-ab83-3c4f9b75c5eb tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] [instance: 348b2621-1bf9-431b-b639-9aabbf68a3cf] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:52.136901 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-ed29aeeb-fc27-4ce4-ab83-3c4f9b75c5eb tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a95d9f48c64b0fbb8879d361bc177d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019734069da44b2d88561549bd07544d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:52.145445 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-ed29aeeb-fc27-4ce4-ab83-3c4f9b75c5eb tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] 10.222.0.45 "GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf" status: 200 len: 1258 microversion: 2.1 time: 0.115659 Aug 01 16:40:52.146279 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 94/179] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:40:52 2022] GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf => generated 1258 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:40:52.206548 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-ba19f9c4-e5f6-447b-96c3-8408ccb2725e tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:52.216995 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-ba19f9c4-e5f6-447b-96c3-8408ccb2725e tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7" status: 200 len: 1522 microversion: 2.1 time: 0.295821 Aug 01 16:40:52.231968 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 86/180] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:40:51 2022] GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7 => generated 1522 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:40:52.440755 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [req-89a7b311-419c-4190-a26b-9ee3cedcd78e req-6c904168-9603-4257-a262-1154a2e8920e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "016ea7a5-9bd1-4a28-baec-19dc96fd478c", "tag": "bfec3419-d211-4e0a-8a90-3c22626f6acb"}]} {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:40:52.455632 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-89a7b311-419c-4190-a26b-9ee3cedcd78e req-6c904168-9603-4257-a262-1154a2e8920e service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:52.457560 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-89a7b311-419c-4190-a26b-9ee3cedcd78e req-6c904168-9603-4257-a262-1154a2e8920e service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:52.479752 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.compute.server_external_events [req-89a7b311-419c-4190-a26b-9ee3cedcd78e req-6c904168-9603-4257-a262-1154a2e8920e service nova] Creating event network-changed:bfec3419-d211-4e0a-8a90-3c22626f6acb for instance 016ea7a5-9bd1-4a28-baec-19dc96fd478c on hv-cinder-85032 Aug 01 16:40:52.488942 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [req-89a7b311-419c-4190-a26b-9ee3cedcd78e req-6c904168-9603-4257-a262-1154a2e8920e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053161 Aug 01 16:40:52.489610 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 95/181] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:40:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 16:40:52.946831 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-08ae0f3b-f4e2-4940-aa86-52b0b6db7108 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:52.947551 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-08ae0f3b-f4e2-4940-aa86-52b0b6db7108 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] [instance: 016ea7a5-9bd1-4a28-baec-19dc96fd478c] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:52.954718 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-08ae0f3b-f4e2-4940-aa86-52b0b6db7108 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:52.955582 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-08ae0f3b-f4e2-4940-aa86-52b0b6db7108 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:52.956634 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-08ae0f3b-f4e2-4940-aa86-52b0b6db7108 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:52.957268 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-08ae0f3b-f4e2-4940-aa86-52b0b6db7108 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:53.142348 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-08ae0f3b-f4e2-4940-aa86-52b0b6db7108 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c08c97c2fb446ba2d363c8a18d4958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31add21e55d4704b8285a700af04410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:53.152001 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-08ae0f3b-f4e2-4940-aa86-52b0b6db7108 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] 10.222.0.45 "GET /compute/v2.1/servers/016ea7a5-9bd1-4a28-baec-19dc96fd478c" status: 200 len: 1314 microversion: 2.1 time: 0.208880 Aug 01 16:40:53.152401 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 87/182] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:40:52 2022] GET /compute/v2.1/servers/016ea7a5-9bd1-4a28-baec-19dc96fd478c => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:40:53.171505 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-a71fedc3-f268-445c-a0d5-1cb6b0bd557e tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:53.172837 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-a71fedc3-f268-445c-a0d5-1cb6b0bd557e tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] [instance: 348b2621-1bf9-431b-b639-9aabbf68a3cf] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:53.181147 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a71fedc3-f268-445c-a0d5-1cb6b0bd557e tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:53.192885 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a71fedc3-f268-445c-a0d5-1cb6b0bd557e tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:53.193964 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a71fedc3-f268-445c-a0d5-1cb6b0bd557e tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:53.194405 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a71fedc3-f268-445c-a0d5-1cb6b0bd557e tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:53.242749 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-68f563be-b4dd-4a19-9661-781708d2d0cb tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:53.243575 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-68f563be-b4dd-4a19-9661-781708d2d0cb tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:53.261292 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-68f563be-b4dd-4a19-9661-781708d2d0cb tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:53.262115 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-68f563be-b4dd-4a19-9661-781708d2d0cb tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:53.263122 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-68f563be-b4dd-4a19-9661-781708d2d0cb tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:53.263701 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-68f563be-b4dd-4a19-9661-781708d2d0cb tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:53.303923 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-a71fedc3-f268-445c-a0d5-1cb6b0bd557e tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a95d9f48c64b0fbb8879d361bc177d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019734069da44b2d88561549bd07544d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:53.312799 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-a71fedc3-f268-445c-a0d5-1cb6b0bd557e tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] 10.222.0.45 "GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf" status: 200 len: 1310 microversion: 2.1 time: 0.145372 Aug 01 16:40:53.313387 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 96/183] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:40:53 2022] GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf => generated 1310 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:40:53.437720 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-68f563be-b4dd-4a19-9661-781708d2d0cb tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:53.449191 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-68f563be-b4dd-4a19-9661-781708d2d0cb tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7" status: 200 len: 1522 microversion: 2.1 time: 0.209156 Aug 01 16:40:53.451839 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 88/184] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:40:53 2022] GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7 => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:40:54.175401 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-16c23834-174b-4056-a80e-9c70617d30d6 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:54.176772 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-16c23834-174b-4056-a80e-9c70617d30d6 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] [instance: 016ea7a5-9bd1-4a28-baec-19dc96fd478c] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:54.186036 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-16c23834-174b-4056-a80e-9c70617d30d6 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:54.186474 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-16c23834-174b-4056-a80e-9c70617d30d6 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:54.187801 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-16c23834-174b-4056-a80e-9c70617d30d6 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:54.188601 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-16c23834-174b-4056-a80e-9c70617d30d6 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:54.334745 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-92a82235-42db-4821-82e3-3e6cf2976e15 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:54.336251 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-92a82235-42db-4821-82e3-3e6cf2976e15 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] [instance: 348b2621-1bf9-431b-b639-9aabbf68a3cf] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:54.349753 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-92a82235-42db-4821-82e3-3e6cf2976e15 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:54.350734 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-92a82235-42db-4821-82e3-3e6cf2976e15 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:54.353813 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-92a82235-42db-4821-82e3-3e6cf2976e15 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:54.354296 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-92a82235-42db-4821-82e3-3e6cf2976e15 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:54.493013 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-92a82235-42db-4821-82e3-3e6cf2976e15 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a95d9f48c64b0fbb8879d361bc177d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019734069da44b2d88561549bd07544d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:54.508261 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-92a82235-42db-4821-82e3-3e6cf2976e15 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] 10.222.0.45 "GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf" status: 200 len: 1328 microversion: 2.1 time: 0.177341 Aug 01 16:40:54.519794 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 89/185] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:40:54 2022] GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf => generated 1328 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:40:54.520168 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-89f6e112-e709-4fb2-97bf-a61360793479 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:54.521032 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-89f6e112-e709-4fb2-97bf-a61360793479 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:54.530544 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-89f6e112-e709-4fb2-97bf-a61360793479 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:54.531000 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-89f6e112-e709-4fb2-97bf-a61360793479 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:54.531925 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-89f6e112-e709-4fb2-97bf-a61360793479 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:54.532312 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-89f6e112-e709-4fb2-97bf-a61360793479 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:54.630656 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-16c23834-174b-4056-a80e-9c70617d30d6 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c08c97c2fb446ba2d363c8a18d4958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31add21e55d4704b8285a700af04410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:54.641503 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-16c23834-174b-4056-a80e-9c70617d30d6 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] 10.222.0.45 "GET /compute/v2.1/servers/016ea7a5-9bd1-4a28-baec-19dc96fd478c" status: 200 len: 1314 microversion: 2.1 time: 0.471704 Aug 01 16:40:54.644497 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 97/186] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:40:54 2022] GET /compute/v2.1/servers/016ea7a5-9bd1-4a28-baec-19dc96fd478c => generated 1314 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:40:54.866703 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-89f6e112-e709-4fb2-97bf-a61360793479 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:54.877735 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-89f6e112-e709-4fb2-97bf-a61360793479 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7" status: 200 len: 1522 microversion: 2.1 time: 0.365868 Aug 01 16:40:54.879663 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 90/187] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:40:54 2022] GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7 => generated 1522 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:40:55.533833 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-bedc2512-86f1-49d7-91bb-1d3189b76581 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:55.535283 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-bedc2512-86f1-49d7-91bb-1d3189b76581 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] [instance: 348b2621-1bf9-431b-b639-9aabbf68a3cf] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:55.565941 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-bedc2512-86f1-49d7-91bb-1d3189b76581 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:55.566652 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-bedc2512-86f1-49d7-91bb-1d3189b76581 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:55.568691 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-bedc2512-86f1-49d7-91bb-1d3189b76581 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:55.571417 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-bedc2512-86f1-49d7-91bb-1d3189b76581 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:55.670594 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-a4ac803f-6ad5-49e6-95e4-f5e9a815aaf2 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:55.674560 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-a4ac803f-6ad5-49e6-95e4-f5e9a815aaf2 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] [instance: 016ea7a5-9bd1-4a28-baec-19dc96fd478c] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:55.703317 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-a4ac803f-6ad5-49e6-95e4-f5e9a815aaf2 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:55.720774 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-a4ac803f-6ad5-49e6-95e4-f5e9a815aaf2 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:55.725827 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-a4ac803f-6ad5-49e6-95e4-f5e9a815aaf2 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:55.726495 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-a4ac803f-6ad5-49e6-95e4-f5e9a815aaf2 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:55.772560 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_cell1:SELECT=100 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:40:56.131467 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-bedc2512-86f1-49d7-91bb-1d3189b76581 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a95d9f48c64b0fbb8879d361bc177d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019734069da44b2d88561549bd07544d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:56.148142 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-bedc2512-86f1-49d7-91bb-1d3189b76581 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] 10.222.0.45 "GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf" status: 200 len: 1358 microversion: 2.1 time: 0.619851 Aug 01 16:40:56.164203 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 98/188] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:40:55 2022] GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf => generated 1358 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:40:56.175956 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-2047791b-b728-4998-811c-49d33335d9f2 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:56.176579 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-2047791b-b728-4998-811c-49d33335d9f2 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:56.197532 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-2047791b-b728-4998-811c-49d33335d9f2 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:56.197986 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-2047791b-b728-4998-811c-49d33335d9f2 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:56.198814 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-2047791b-b728-4998-811c-49d33335d9f2 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:56.199250 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-2047791b-b728-4998-811c-49d33335d9f2 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:56.331655 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-a4ac803f-6ad5-49e6-95e4-f5e9a815aaf2 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c08c97c2fb446ba2d363c8a18d4958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31add21e55d4704b8285a700af04410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:56.340983 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-a4ac803f-6ad5-49e6-95e4-f5e9a815aaf2 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] 10.222.0.45 "GET /compute/v2.1/servers/016ea7a5-9bd1-4a28-baec-19dc96fd478c" status: 200 len: 1314 microversion: 2.1 time: 0.678111 Aug 01 16:40:56.344704 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 91/189] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:40:55 2022] GET /compute/v2.1/servers/016ea7a5-9bd1-4a28-baec-19dc96fd478c => generated 1314 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:40:56.525085 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-2047791b-b728-4998-811c-49d33335d9f2 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:56.537978 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-2047791b-b728-4998-811c-49d33335d9f2 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7" status: 200 len: 1522 microversion: 2.1 time: 0.372355 Aug 01 16:40:56.539857 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 99/190] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:40:56 2022] GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7 => generated 1522 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:40:56.919956 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [req-39b2bf31-51a9-41da-aaed-a6b2084d2e1e req-374ff73e-87f3-4e25-96b3-4582e3deff79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "348b2621-1bf9-431b-b639-9aabbf68a3cf", "tag": "8967f796-0a7a-4c6f-b2f7-18a05072b7c4"}]} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:40:56.940696 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-39b2bf31-51a9-41da-aaed-a6b2084d2e1e req-374ff73e-87f3-4e25-96b3-4582e3deff79 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:56.941477 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-39b2bf31-51a9-41da-aaed-a6b2084d2e1e req-374ff73e-87f3-4e25-96b3-4582e3deff79 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:56.957617 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.compute.server_external_events [req-39b2bf31-51a9-41da-aaed-a6b2084d2e1e req-374ff73e-87f3-4e25-96b3-4582e3deff79 service nova] Creating event network-changed:8967f796-0a7a-4c6f-b2f7-18a05072b7c4 for instance 348b2621-1bf9-431b-b639-9aabbf68a3cf on hv-cinder-85032 Aug 01 16:40:56.963656 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [req-39b2bf31-51a9-41da-aaed-a6b2084d2e1e req-374ff73e-87f3-4e25-96b3-4582e3deff79 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049662 Aug 01 16:40:56.964590 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 92/191] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:40:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 16:40:57.172186 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-01483566-b21d-47d9-84cf-594d7d7443a1 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:57.173062 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-01483566-b21d-47d9-84cf-594d7d7443a1 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] [instance: 348b2621-1bf9-431b-b639-9aabbf68a3cf] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:57.187375 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-01483566-b21d-47d9-84cf-594d7d7443a1 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:57.193128 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-01483566-b21d-47d9-84cf-594d7d7443a1 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:57.194210 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-01483566-b21d-47d9-84cf-594d7d7443a1 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:57.196553 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-01483566-b21d-47d9-84cf-594d7d7443a1 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:57.324761 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [req-6e86dea8-0834-4c7b-827e-61b02a56e4d7 req-308da60f-894e-41cc-9daa-6ed8abbb327d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "016ea7a5-9bd1-4a28-baec-19dc96fd478c", "name": "network-vif-plugged", "status": "completed", "tag": "bfec3419-d211-4e0a-8a90-3c22626f6acb"}]} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:40:57.357375 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-6e86dea8-0834-4c7b-827e-61b02a56e4d7 req-308da60f-894e-41cc-9daa-6ed8abbb327d service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:57.361790 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-6e86dea8-0834-4c7b-827e-61b02a56e4d7 req-308da60f-894e-41cc-9daa-6ed8abbb327d service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:57.407273 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.compute.server_external_events [req-6e86dea8-0834-4c7b-827e-61b02a56e4d7 req-308da60f-894e-41cc-9daa-6ed8abbb327d service nova] Creating event network-vif-plugged:bfec3419-d211-4e0a-8a90-3c22626f6acb for instance 016ea7a5-9bd1-4a28-baec-19dc96fd478c on hv-cinder-85032 Aug 01 16:40:57.427683 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [req-6e86dea8-0834-4c7b-827e-61b02a56e4d7 req-308da60f-894e-41cc-9daa-6ed8abbb327d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108071 Aug 01 16:40:57.431395 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 93/192] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:40:57.456167 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-2fb604c3-4089-4390-b27f-a9c9b939cac8 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:57.458940 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-2fb604c3-4089-4390-b27f-a9c9b939cac8 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] [instance: 016ea7a5-9bd1-4a28-baec-19dc96fd478c] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:57.477607 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-2fb604c3-4089-4390-b27f-a9c9b939cac8 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:57.478845 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-2fb604c3-4089-4390-b27f-a9c9b939cac8 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:57.481626 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-2fb604c3-4089-4390-b27f-a9c9b939cac8 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:57.483673 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-2fb604c3-4089-4390-b27f-a9c9b939cac8 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:57.493479 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-01483566-b21d-47d9-84cf-594d7d7443a1 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a95d9f48c64b0fbb8879d361bc177d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019734069da44b2d88561549bd07544d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:57.502645 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-01483566-b21d-47d9-84cf-594d7d7443a1 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] 10.222.0.45 "GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf" status: 200 len: 1358 microversion: 2.1 time: 0.334722 Aug 01 16:40:57.517085 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 100/193] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:40:57 2022] GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf => generated 1358 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:40:57.562159 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-dcc799a1-0eae-4f07-89f0-1f9d0242ce49 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:57.562751 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-dcc799a1-0eae-4f07-89f0-1f9d0242ce49 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:57.571936 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-dcc799a1-0eae-4f07-89f0-1f9d0242ce49 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:57.572376 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-dcc799a1-0eae-4f07-89f0-1f9d0242ce49 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:57.573174 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-dcc799a1-0eae-4f07-89f0-1f9d0242ce49 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:57.573592 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-dcc799a1-0eae-4f07-89f0-1f9d0242ce49 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:57.940291 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-2fb604c3-4089-4390-b27f-a9c9b939cac8 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c08c97c2fb446ba2d363c8a18d4958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31add21e55d4704b8285a700af04410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:57.960045 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-2fb604c3-4089-4390-b27f-a9c9b939cac8 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] 10.222.0.45 "GET /compute/v2.1/servers/016ea7a5-9bd1-4a28-baec-19dc96fd478c" status: 200 len: 1314 microversion: 2.1 time: 0.518393 Aug 01 16:40:57.973967 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 94/194] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:40:57 2022] GET /compute/v2.1/servers/016ea7a5-9bd1-4a28-baec-19dc96fd478c => generated 1314 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:40:58.033660 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-dcc799a1-0eae-4f07-89f0-1f9d0242ce49 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:58.056183 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-dcc799a1-0eae-4f07-89f0-1f9d0242ce49 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7" status: 200 len: 1522 microversion: 2.1 time: 0.497695 Aug 01 16:40:58.070320 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 101/195] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:40:57 2022] GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7 => generated 1522 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:40:58.526223 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-6cf7e3ef-dea7-4a21-ad37-b166b9021f27 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:58.529703 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-6cf7e3ef-dea7-4a21-ad37-b166b9021f27 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] [instance: 348b2621-1bf9-431b-b639-9aabbf68a3cf] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:58.540720 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-6cf7e3ef-dea7-4a21-ad37-b166b9021f27 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:58.546070 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-6cf7e3ef-dea7-4a21-ad37-b166b9021f27 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:58.547339 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-6cf7e3ef-dea7-4a21-ad37-b166b9021f27 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:58.548091 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-6cf7e3ef-dea7-4a21-ad37-b166b9021f27 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:58.802908 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-6cf7e3ef-dea7-4a21-ad37-b166b9021f27 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a95d9f48c64b0fbb8879d361bc177d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019734069da44b2d88561549bd07544d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:58.813554 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-6cf7e3ef-dea7-4a21-ad37-b166b9021f27 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] 10.222.0.45 "GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf" status: 200 len: 1358 microversion: 2.1 time: 0.291471 Aug 01 16:40:58.832710 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 95/196] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:40:58 2022] GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf => generated 1358 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:40:58.984122 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-5c9ba722-e66b-4de2-a7de-c38d0d5711e9 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:58.984831 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-5c9ba722-e66b-4de2-a7de-c38d0d5711e9 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] [instance: 016ea7a5-9bd1-4a28-baec-19dc96fd478c] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:58.991897 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-5c9ba722-e66b-4de2-a7de-c38d0d5711e9 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:58.992456 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-5c9ba722-e66b-4de2-a7de-c38d0d5711e9 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:58.993332 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-5c9ba722-e66b-4de2-a7de-c38d0d5711e9 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:58.993830 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-5c9ba722-e66b-4de2-a7de-c38d0d5711e9 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:59.092116 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-69b95824-35bb-45b6-87fd-e9e1741a485c tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:59.093433 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-69b95824-35bb-45b6-87fd-e9e1741a485c tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:59.101108 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-69b95824-35bb-45b6-87fd-e9e1741a485c tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:59.101863 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-69b95824-35bb-45b6-87fd-e9e1741a485c tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:59.102823 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-69b95824-35bb-45b6-87fd-e9e1741a485c tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:59.103432 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-69b95824-35bb-45b6-87fd-e9e1741a485c tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:59.527522 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-69b95824-35bb-45b6-87fd-e9e1741a485c tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:59.539179 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-69b95824-35bb-45b6-87fd-e9e1741a485c tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7" status: 200 len: 1522 microversion: 2.1 time: 0.452143 Aug 01 16:40:59.540545 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 96/197] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:40:59 2022] GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7 => generated 1522 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:40:59.542592 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-5c9ba722-e66b-4de2-a7de-c38d0d5711e9 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c08c97c2fb446ba2d363c8a18d4958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31add21e55d4704b8285a700af04410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:40:59.578812 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-5c9ba722-e66b-4de2-a7de-c38d0d5711e9 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] 10.222.0.45 "GET /compute/v2.1/servers/016ea7a5-9bd1-4a28-baec-19dc96fd478c" status: 200 len: 1314 microversion: 2.1 time: 0.600253 Aug 01 16:40:59.579439 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 102/198] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:40:58 2022] GET /compute/v2.1/servers/016ea7a5-9bd1-4a28-baec-19dc96fd478c => generated 1314 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:40:59.697069 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-b79edc97-777c-4c9f-9eb1-ef5e41c8fe6d tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:59.697963 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-b79edc97-777c-4c9f-9eb1-ef5e41c8fe6d tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: a3f6b512-e3cb-4e87-8d82-c64f6f1640db] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:59.705054 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-b79edc97-777c-4c9f-9eb1-ef5e41c8fe6d tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:59.705708 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-b79edc97-777c-4c9f-9eb1-ef5e41c8fe6d tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:59.706596 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-b79edc97-777c-4c9f-9eb1-ef5e41c8fe6d tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:59.707098 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-b79edc97-777c-4c9f-9eb1-ef5e41c8fe6d tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:59.736813 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-b79edc97-777c-4c9f-9eb1-ef5e41c8fe6d tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db/ips" status: 200 len: 144 microversion: 2.1 time: 0.043806 Aug 01 16:40:59.738224 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 97/199] 10.222.0.45 () {58 vars in 1248 bytes} [Mon Aug 1 16:40:59 2022] GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db/ips => generated 144 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:40:59.857985 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-090c26f5-0f23-4dd8-8ef7-5343439db405 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:40:59.859033 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-090c26f5-0f23-4dd8-8ef7-5343439db405 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] [instance: 348b2621-1bf9-431b-b639-9aabbf68a3cf] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:40:59.867686 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-090c26f5-0f23-4dd8-8ef7-5343439db405 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:59.869175 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-090c26f5-0f23-4dd8-8ef7-5343439db405 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:40:59.870041 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-090c26f5-0f23-4dd8-8ef7-5343439db405 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:40:59.870664 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-090c26f5-0f23-4dd8-8ef7-5343439db405 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:00.127365 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-090c26f5-0f23-4dd8-8ef7-5343439db405 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a95d9f48c64b0fbb8879d361bc177d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019734069da44b2d88561549bd07544d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:00.141902 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-090c26f5-0f23-4dd8-8ef7-5343439db405 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] 10.222.0.45 "GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf" status: 200 len: 1358 microversion: 2.1 time: 0.283326 Aug 01 16:41:00.143358 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 103/200] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:40:59 2022] GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf => generated 1358 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:00.564321 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-7787e032-0773-45ab-a003-201ad9e0e469 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:00.565209 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-7787e032-0773-45ab-a003-201ad9e0e469 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:00.573027 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-7787e032-0773-45ab-a003-201ad9e0e469 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:00.573578 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-7787e032-0773-45ab-a003-201ad9e0e469 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:00.576723 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-7787e032-0773-45ab-a003-201ad9e0e469 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:00.577554 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-7787e032-0773-45ab-a003-201ad9e0e469 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:00.601043 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-0626a7fe-f734-421f-b3a0-856b945414dd tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:00.604528 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-0626a7fe-f734-421f-b3a0-856b945414dd tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] [instance: 016ea7a5-9bd1-4a28-baec-19dc96fd478c] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:00.608327 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-0626a7fe-f734-421f-b3a0-856b945414dd tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:00.608896 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-0626a7fe-f734-421f-b3a0-856b945414dd tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:00.609863 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-0626a7fe-f734-421f-b3a0-856b945414dd tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:00.610289 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-0626a7fe-f734-421f-b3a0-856b945414dd tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:00.744821 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_cell0:SELECT=6 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:41:00.877761 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-7787e032-0773-45ab-a003-201ad9e0e469 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:00.899597 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-7787e032-0773-45ab-a003-201ad9e0e469 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7" status: 200 len: 1522 microversion: 2.1 time: 0.342196 Aug 01 16:41:00.900245 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 98/201] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:00 2022] GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7 => generated 1522 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:00.908212 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-0626a7fe-f734-421f-b3a0-856b945414dd tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c08c97c2fb446ba2d363c8a18d4958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31add21e55d4704b8285a700af04410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:00.919554 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-0626a7fe-f734-421f-b3a0-856b945414dd tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] 10.222.0.45 "GET /compute/v2.1/servers/016ea7a5-9bd1-4a28-baec-19dc96fd478c" status: 200 len: 1314 microversion: 2.1 time: 0.323750 Aug 01 16:41:00.920465 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 104/202] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:00 2022] GET /compute/v2.1/servers/016ea7a5-9bd1-4a28-baec-19dc96fd478c => generated 1314 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:01.164994 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-2e65f26d-5f43-4f95-8337-a039312e1954 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:01.165664 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-2e65f26d-5f43-4f95-8337-a039312e1954 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] [instance: 348b2621-1bf9-431b-b639-9aabbf68a3cf] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:01.172718 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-2e65f26d-5f43-4f95-8337-a039312e1954 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:01.173814 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-2e65f26d-5f43-4f95-8337-a039312e1954 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:01.174779 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-2e65f26d-5f43-4f95-8337-a039312e1954 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:01.175535 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-2e65f26d-5f43-4f95-8337-a039312e1954 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:01.459166 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-2e65f26d-5f43-4f95-8337-a039312e1954 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a95d9f48c64b0fbb8879d361bc177d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019734069da44b2d88561549bd07544d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:01.470967 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-2e65f26d-5f43-4f95-8337-a039312e1954 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] 10.222.0.45 "GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf" status: 200 len: 1358 microversion: 2.1 time: 0.310130 Aug 01 16:41:01.472288 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 99/203] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:01 2022] GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf => generated 1358 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:01.922560 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-9f98bd90-d8ba-461a-9834-c0d219fed321 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:01.923175 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-9f98bd90-d8ba-461a-9834-c0d219fed321 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:01.925603 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_cell0:SELECT=4 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:41:01.942174 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-9f98bd90-d8ba-461a-9834-c0d219fed321 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:01.942624 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-9f98bd90-d8ba-461a-9834-c0d219fed321 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:01.942877 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-95beba1b-91f0-4ffe-8ca2-1d32ab1e9565 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:01.943400 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-9f98bd90-d8ba-461a-9834-c0d219fed321 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:01.943838 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-9f98bd90-d8ba-461a-9834-c0d219fed321 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:01.944598 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-95beba1b-91f0-4ffe-8ca2-1d32ab1e9565 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] [instance: 016ea7a5-9bd1-4a28-baec-19dc96fd478c] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:01.952813 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-95beba1b-91f0-4ffe-8ca2-1d32ab1e9565 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:01.953640 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-95beba1b-91f0-4ffe-8ca2-1d32ab1e9565 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:01.954673 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-95beba1b-91f0-4ffe-8ca2-1d32ab1e9565 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:01.955316 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-95beba1b-91f0-4ffe-8ca2-1d32ab1e9565 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:02.141933 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_cell0:SELECT=14 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:41:02.371996 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-9f98bd90-d8ba-461a-9834-c0d219fed321 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:02.385406 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-9f98bd90-d8ba-461a-9834-c0d219fed321 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7" status: 200 len: 1522 microversion: 2.1 time: 0.463959 Aug 01 16:41:02.387501 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-95beba1b-91f0-4ffe-8ca2-1d32ab1e9565 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c08c97c2fb446ba2d363c8a18d4958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31add21e55d4704b8285a700af04410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:02.395698 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-95beba1b-91f0-4ffe-8ca2-1d32ab1e9565 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] 10.222.0.45 "GET /compute/v2.1/servers/016ea7a5-9bd1-4a28-baec-19dc96fd478c" status: 200 len: 1314 microversion: 2.1 time: 0.456949 Aug 01 16:41:02.396322 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 100/204] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:01 2022] GET /compute/v2.1/servers/016ea7a5-9bd1-4a28-baec-19dc96fd478c => generated 1314 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:41:02.404174 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 105/205] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:01 2022] GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7 => generated 1522 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:02.493640 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-655e2e95-897d-427d-a4d7-5ba3f91b1b5b tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:02.494345 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-655e2e95-897d-427d-a4d7-5ba3f91b1b5b tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] [instance: 348b2621-1bf9-431b-b639-9aabbf68a3cf] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:02.501160 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-655e2e95-897d-427d-a4d7-5ba3f91b1b5b tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:02.502640 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-655e2e95-897d-427d-a4d7-5ba3f91b1b5b tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:02.503624 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-655e2e95-897d-427d-a4d7-5ba3f91b1b5b tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:02.504227 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-655e2e95-897d-427d-a4d7-5ba3f91b1b5b tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:02.799454 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-655e2e95-897d-427d-a4d7-5ba3f91b1b5b tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a95d9f48c64b0fbb8879d361bc177d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019734069da44b2d88561549bd07544d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:02.807673 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-655e2e95-897d-427d-a4d7-5ba3f91b1b5b tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] 10.222.0.45 "GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf" status: 200 len: 1358 microversion: 2.1 time: 0.318168 Aug 01 16:41:02.811434 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 101/206] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:02 2022] GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf => generated 1358 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:03.413016 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-877e3bfd-5fd2-430a-bc00-a3e49163eb66 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:03.413733 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-877e3bfd-5fd2-430a-bc00-a3e49163eb66 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:03.420317 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-3d512ddf-fcdc-42e8-a42c-5786ace6a07f tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:03.421706 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-3d512ddf-fcdc-42e8-a42c-5786ace6a07f tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] [instance: 016ea7a5-9bd1-4a28-baec-19dc96fd478c] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:03.422080 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-877e3bfd-5fd2-430a-bc00-a3e49163eb66 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:03.422667 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-877e3bfd-5fd2-430a-bc00-a3e49163eb66 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:03.424505 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-877e3bfd-5fd2-430a-bc00-a3e49163eb66 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:03.424962 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-877e3bfd-5fd2-430a-bc00-a3e49163eb66 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:03.430103 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-3d512ddf-fcdc-42e8-a42c-5786ace6a07f tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:03.430808 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-3d512ddf-fcdc-42e8-a42c-5786ace6a07f tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:03.431412 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-3d512ddf-fcdc-42e8-a42c-5786ace6a07f tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:03.432143 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-3d512ddf-fcdc-42e8-a42c-5786ace6a07f tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:03.891088 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-877e3bfd-5fd2-430a-bc00-a3e49163eb66 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:03.906390 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-877e3bfd-5fd2-430a-bc00-a3e49163eb66 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7" status: 200 len: 1522 microversion: 2.1 time: 0.498742 Aug 01 16:41:03.906999 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 106/207] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:03 2022] GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7 => generated 1522 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:03.918966 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-12d3f839-1995-406e-b19e-99ea6eb27828 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:03.919899 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-12d3f839-1995-406e-b19e-99ea6eb27828 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] [instance: 348b2621-1bf9-431b-b639-9aabbf68a3cf] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:03.934230 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-12d3f839-1995-406e-b19e-99ea6eb27828 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:03.935262 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-12d3f839-1995-406e-b19e-99ea6eb27828 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:03.936491 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-12d3f839-1995-406e-b19e-99ea6eb27828 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:03.937134 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-12d3f839-1995-406e-b19e-99ea6eb27828 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:03.937697 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-3d512ddf-fcdc-42e8-a42c-5786ace6a07f tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c08c97c2fb446ba2d363c8a18d4958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31add21e55d4704b8285a700af04410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:03.942899 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_cell1:SELECT=100 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:41:03.950778 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-3d512ddf-fcdc-42e8-a42c-5786ace6a07f tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] 10.222.0.45 "GET /compute/v2.1/servers/016ea7a5-9bd1-4a28-baec-19dc96fd478c" status: 200 len: 1314 microversion: 2.1 time: 0.534510 Aug 01 16:41:03.951874 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 102/208] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:03 2022] GET /compute/v2.1/servers/016ea7a5-9bd1-4a28-baec-19dc96fd478c => generated 1314 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:41:03.960313 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-b44f6797-cd8b-45a1-81c1-c7c10a83ea05 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dbc5ba7d-87f8-4fd2-b18c-f03c7982ad41"}} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:41:03.963695 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-b44f6797-cd8b-45a1-81c1-c7c10a83ea05 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: a3f6b512-e3cb-4e87-8d82-c64f6f1640db] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:03.993137 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-b44f6797-cd8b-45a1-81c1-c7c10a83ea05 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:03.995068 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-b44f6797-cd8b-45a1-81c1-c7c10a83ea05 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:03.997983 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-b44f6797-cd8b-45a1-81c1-c7c10a83ea05 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:03.998715 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-b44f6797-cd8b-45a1-81c1-c7c10a83ea05 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:04.158082 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-12d3f839-1995-406e-b19e-99ea6eb27828 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a95d9f48c64b0fbb8879d361bc177d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019734069da44b2d88561549bd07544d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:04.168506 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-12d3f839-1995-406e-b19e-99ea6eb27828 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] 10.222.0.45 "GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf" status: 200 len: 1358 microversion: 2.1 time: 0.255914 Aug 01 16:41:04.169693 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 107/209] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:03 2022] GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf => generated 1358 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:04.793137 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-eee8680d-9a7f-4e22-82e4-929a81a89400 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:04.793772 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-eee8680d-9a7f-4e22-82e4-929a81a89400 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:04.801357 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-eee8680d-9a7f-4e22-82e4-929a81a89400 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:04.801811 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-eee8680d-9a7f-4e22-82e4-929a81a89400 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:04.802576 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-eee8680d-9a7f-4e22-82e4-929a81a89400 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:04.803005 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-eee8680d-9a7f-4e22-82e4-929a81a89400 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:04.832174 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-eee8680d-9a7f-4e22-82e4-929a81a89400 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e/ips" status: 200 len: 152 microversion: 2.20 time: 0.043657 Aug 01 16:41:04.839406 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 108/210] 10.222.0.45 () {60 vars in 1289 bytes} [Mon Aug 1 16:41:04 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e/ips => generated 152 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 16:41:04.932469 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-0b4d3422-84f5-4fd9-a9f5-8cc2f6415149 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:04.933088 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-0b4d3422-84f5-4fd9-a9f5-8cc2f6415149 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:04.939454 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-0b4d3422-84f5-4fd9-a9f5-8cc2f6415149 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:04.940280 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-0b4d3422-84f5-4fd9-a9f5-8cc2f6415149 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:04.941075 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-0b4d3422-84f5-4fd9-a9f5-8cc2f6415149 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:04.942069 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-0b4d3422-84f5-4fd9-a9f5-8cc2f6415149 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:05.173085 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-0b4d3422-84f5-4fd9-a9f5-8cc2f6415149 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:05.187245 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-0b4d3422-84f5-4fd9-a9f5-8cc2f6415149 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7" status: 200 len: 1522 microversion: 2.1 time: 0.258705 Aug 01 16:41:05.196342 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 109/211] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:04 2022] GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7 => generated 1522 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:05.201962 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-496eabdf-8329-46d4-bccb-0bddbce7c364 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:05.203469 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-496eabdf-8329-46d4-bccb-0bddbce7c364 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] [instance: 016ea7a5-9bd1-4a28-baec-19dc96fd478c] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:05.222489 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-496eabdf-8329-46d4-bccb-0bddbce7c364 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:05.225288 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-496eabdf-8329-46d4-bccb-0bddbce7c364 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:05.226225 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-496eabdf-8329-46d4-bccb-0bddbce7c364 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:05.226677 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-496eabdf-8329-46d4-bccb-0bddbce7c364 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:05.403713 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-b44f6797-cd8b-45a1-81c1-c7c10a83ea05 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "POST /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.450312 Aug 01 16:41:05.405139 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 103/212] 10.222.0.45 () {60 vars in 1323 bytes} [Mon Aug 1 16:41:03 2022] POST /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db/os-volume_attachments => generated 194 bytes in 1452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:41:05.429346 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-a0b068c4-6212-4fdd-ba9d-aaacb246971e tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:05.432212 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-a0b068c4-6212-4fdd-ba9d-aaacb246971e tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] [instance: 348b2621-1bf9-431b-b639-9aabbf68a3cf] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:05.447791 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-a0b068c4-6212-4fdd-ba9d-aaacb246971e tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:05.449277 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-a0b068c4-6212-4fdd-ba9d-aaacb246971e tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:05.452159 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-a0b068c4-6212-4fdd-ba9d-aaacb246971e tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:05.454178 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-a0b068c4-6212-4fdd-ba9d-aaacb246971e tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:05.590828 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-496eabdf-8329-46d4-bccb-0bddbce7c364 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c08c97c2fb446ba2d363c8a18d4958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31add21e55d4704b8285a700af04410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:05.599556 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-496eabdf-8329-46d4-bccb-0bddbce7c364 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] 10.222.0.45 "GET /compute/v2.1/servers/016ea7a5-9bd1-4a28-baec-19dc96fd478c" status: 200 len: 1314 microversion: 2.1 time: 0.401754 Aug 01 16:41:05.600530 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 110/213] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:05 2022] GET /compute/v2.1/servers/016ea7a5-9bd1-4a28-baec-19dc96fd478c => generated 1314 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:05.639445 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-a0b068c4-6212-4fdd-ba9d-aaacb246971e tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a95d9f48c64b0fbb8879d361bc177d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019734069da44b2d88561549bd07544d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:05.647704 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-a0b068c4-6212-4fdd-ba9d-aaacb246971e tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] 10.222.0.45 "GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf" status: 200 len: 1358 microversion: 2.1 time: 0.240665 Aug 01 16:41:05.648721 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 104/214] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:05 2022] GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf => generated 1358 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:06.216932 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-e638d2f2-69d7-41a6-896f-6e9eccff1e8a tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:06.217531 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-e638d2f2-69d7-41a6-896f-6e9eccff1e8a tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:06.225015 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-e638d2f2-69d7-41a6-896f-6e9eccff1e8a tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:06.225452 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-e638d2f2-69d7-41a6-896f-6e9eccff1e8a tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:06.226380 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-e638d2f2-69d7-41a6-896f-6e9eccff1e8a tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:06.227128 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-e638d2f2-69d7-41a6-896f-6e9eccff1e8a tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:06.621836 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-83addf98-5195-4701-853e-2a7bc53a0e89 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:06.622444 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-83addf98-5195-4701-853e-2a7bc53a0e89 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] [instance: 016ea7a5-9bd1-4a28-baec-19dc96fd478c] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:06.623022 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-e638d2f2-69d7-41a6-896f-6e9eccff1e8a tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:06.625732 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=1 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:41:06.631916 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-83addf98-5195-4701-853e-2a7bc53a0e89 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:06.632189 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-e638d2f2-69d7-41a6-896f-6e9eccff1e8a tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7" status: 200 len: 1522 microversion: 2.1 time: 0.418723 Aug 01 16:41:06.632350 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-83addf98-5195-4701-853e-2a7bc53a0e89 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:06.633136 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-83addf98-5195-4701-853e-2a7bc53a0e89 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:06.633812 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-83addf98-5195-4701-853e-2a7bc53a0e89 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:06.645109 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 111/215] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:06 2022] GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7 => generated 1522 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:06.670058 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-65c09ead-c2e7-4aab-9234-436cc75f3d5b tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:06.670643 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-65c09ead-c2e7-4aab-9234-436cc75f3d5b tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] [instance: 348b2621-1bf9-431b-b639-9aabbf68a3cf] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:06.681572 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-65c09ead-c2e7-4aab-9234-436cc75f3d5b tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:06.682074 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-65c09ead-c2e7-4aab-9234-436cc75f3d5b tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:06.683245 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-65c09ead-c2e7-4aab-9234-436cc75f3d5b tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:06.683374 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-65c09ead-c2e7-4aab-9234-436cc75f3d5b tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:06.973478 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-83addf98-5195-4701-853e-2a7bc53a0e89 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c08c97c2fb446ba2d363c8a18d4958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31add21e55d4704b8285a700af04410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:06.983674 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-83addf98-5195-4701-853e-2a7bc53a0e89 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] 10.222.0.45 "GET /compute/v2.1/servers/016ea7a5-9bd1-4a28-baec-19dc96fd478c" status: 200 len: 1314 microversion: 2.1 time: 0.365667 Aug 01 16:41:06.985209 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 105/216] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:06 2022] GET /compute/v2.1/servers/016ea7a5-9bd1-4a28-baec-19dc96fd478c => generated 1314 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:07.006528 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-65c09ead-c2e7-4aab-9234-436cc75f3d5b tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a95d9f48c64b0fbb8879d361bc177d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019734069da44b2d88561549bd07544d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:07.014398 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-65c09ead-c2e7-4aab-9234-436cc75f3d5b tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] 10.222.0.45 "GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf" status: 200 len: 1358 microversion: 2.1 time: 0.348330 Aug 01 16:41:07.014984 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 112/217] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:06 2022] GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf => generated 1358 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:07.654552 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-dc08db3a-3706-4d1d-a305-2ee5496f51f4 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:07.655385 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-dc08db3a-3706-4d1d-a305-2ee5496f51f4 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:07.664679 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-dc08db3a-3706-4d1d-a305-2ee5496f51f4 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:07.665439 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-dc08db3a-3706-4d1d-a305-2ee5496f51f4 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:07.666234 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-dc08db3a-3706-4d1d-a305-2ee5496f51f4 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:07.666667 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-dc08db3a-3706-4d1d-a305-2ee5496f51f4 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:07.862370 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-dc08db3a-3706-4d1d-a305-2ee5496f51f4 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:07.874471 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-dc08db3a-3706-4d1d-a305-2ee5496f51f4 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7" status: 200 len: 1522 microversion: 2.1 time: 0.224092 Aug 01 16:41:07.875283 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 106/218] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:07 2022] GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7 => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:08.007359 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-19e99596-86e6-4573-978d-2d99574b1bda tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:08.008083 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-19e99596-86e6-4573-978d-2d99574b1bda tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] [instance: 016ea7a5-9bd1-4a28-baec-19dc96fd478c] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:08.015227 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-19e99596-86e6-4573-978d-2d99574b1bda tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:08.015671 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-19e99596-86e6-4573-978d-2d99574b1bda tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:08.016470 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-19e99596-86e6-4573-978d-2d99574b1bda tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:08.016935 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-19e99596-86e6-4573-978d-2d99574b1bda tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:08.036433 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-58a0057a-f049-440b-bce1-11d72e8dfe6c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:41:08.037284 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-58a0057a-f049-440b-bce1-11d72e8dfe6c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:08.043812 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-58a0057a-f049-440b-bce1-11d72e8dfe6c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:08.044200 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-58a0057a-f049-440b-bce1-11d72e8dfe6c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:08.044975 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-58a0057a-f049-440b-bce1-11d72e8dfe6c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:08.045388 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-58a0057a-f049-440b-bce1-11d72e8dfe6c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:08.073100 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.objects.instance [None req-58a0057a-f049-440b-bce1-11d72e8dfe6c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lazy-loading 'flavor' on Instance uuid f1c8ed71-ea21-4bca-91bf-febe7457300e {{(pid=118117) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 16:41:08.152410 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:41:08.273882 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-19e99596-86e6-4573-978d-2d99574b1bda tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c08c97c2fb446ba2d363c8a18d4958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31add21e55d4704b8285a700af04410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:08.285349 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-19e99596-86e6-4573-978d-2d99574b1bda tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] 10.222.0.45 "GET /compute/v2.1/servers/016ea7a5-9bd1-4a28-baec-19dc96fd478c" status: 200 len: 1314 microversion: 2.1 time: 0.282229 Aug 01 16:41:08.287224 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 113/219] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:08 2022] GET /compute/v2.1/servers/016ea7a5-9bd1-4a28-baec-19dc96fd478c => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:08.295647 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-0fbb0a0e-7b6b-4aca-8147-fd348d56cfe1 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:08.296679 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-0fbb0a0e-7b6b-4aca-8147-fd348d56cfe1 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] [instance: 348b2621-1bf9-431b-b639-9aabbf68a3cf] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:08.306033 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-0fbb0a0e-7b6b-4aca-8147-fd348d56cfe1 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:08.307298 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-0fbb0a0e-7b6b-4aca-8147-fd348d56cfe1 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:08.308674 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-0fbb0a0e-7b6b-4aca-8147-fd348d56cfe1 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:08.309540 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-0fbb0a0e-7b6b-4aca-8147-fd348d56cfe1 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:08.395504 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-58a0057a-f049-440b-bce1-11d72e8dfe6c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "POST /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e/action" status: 202 len: 0 microversion: 2.20 time: 0.363365 Aug 01 16:41:08.400119 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 107/220] 10.222.0.45 () {62 vars in 1319 bytes} [Mon Aug 1 16:41:08 2022] POST /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e/action => generated 0 bytes in 369 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 01 16:41:08.407452 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-7b08ae7d-1ac4-4d53-9c0e-f87c8fae70b6 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:08.408559 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-7b08ae7d-1ac4-4d53-9c0e-f87c8fae70b6 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:08.416400 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-7b08ae7d-1ac4-4d53-9c0e-f87c8fae70b6 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:08.417018 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-7b08ae7d-1ac4-4d53-9c0e-f87c8fae70b6 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:08.418450 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-7b08ae7d-1ac4-4d53-9c0e-f87c8fae70b6 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:08.418886 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-7b08ae7d-1ac4-4d53-9c0e-f87c8fae70b6 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:08.637988 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-0fbb0a0e-7b6b-4aca-8147-fd348d56cfe1 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a95d9f48c64b0fbb8879d361bc177d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019734069da44b2d88561549bd07544d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:08.651599 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-0fbb0a0e-7b6b-4aca-8147-fd348d56cfe1 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] 10.222.0.45 "GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf" status: 200 len: 1358 microversion: 2.1 time: 0.361751 Aug 01 16:41:08.653135 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 114/221] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:08 2022] GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf => generated 1358 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:08.738851 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-7b08ae7d-1ac4-4d53-9c0e-f87c8fae70b6 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:08.750435 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-7b08ae7d-1ac4-4d53-9c0e-f87c8fae70b6 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:08.752426 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-7b08ae7d-1ac4-4d53-9c0e-f87c8fae70b6 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:08.753678 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-7b08ae7d-1ac4-4d53-9c0e-f87c8fae70b6 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1724 microversion: 2.20 time: 0.351903 Aug 01 16:41:08.756808 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 108/222] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:41:08 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1724 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:41:08.899177 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-bc08020d-008c-426e-8c7f-7bd7caf11b7d tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:08.899801 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-bc08020d-008c-426e-8c7f-7bd7caf11b7d tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:08.912646 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-bc08020d-008c-426e-8c7f-7bd7caf11b7d tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:08.913112 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-bc08020d-008c-426e-8c7f-7bd7caf11b7d tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:08.913994 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-bc08020d-008c-426e-8c7f-7bd7caf11b7d tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:08.914491 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-bc08020d-008c-426e-8c7f-7bd7caf11b7d tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:09.062027 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-3993cb5e-7d24-4f96-b151-c8460951bdbd tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:09.062852 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-3993cb5e-7d24-4f96-b151-c8460951bdbd tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 430702ec-add7-4d23-a875-36d09e281f0a] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:09.073571 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-3993cb5e-7d24-4f96-b151-c8460951bdbd tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:09.074425 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-3993cb5e-7d24-4f96-b151-c8460951bdbd tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:09.075452 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-3993cb5e-7d24-4f96-b151-c8460951bdbd tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:09.075906 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-3993cb5e-7d24-4f96-b151-c8460951bdbd tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:09.091514 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-bc08020d-008c-426e-8c7f-7bd7caf11b7d tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:09.099385 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-bc08020d-008c-426e-8c7f-7bd7caf11b7d tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7" status: 200 len: 1522 microversion: 2.1 time: 0.204300 Aug 01 16:41:09.100547 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 115/223] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:08 2022] GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7 => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:09.109928 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-3993cb5e-7d24-4f96-b151-c8460951bdbd tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a/ips" status: 200 len: 146 microversion: 2.1 time: 0.052213 Aug 01 16:41:09.110714 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 109/224] 10.222.0.45 () {58 vars in 1248 bytes} [Mon Aug 1 16:41:09 2022] GET /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a/ips => generated 146 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 16:41:09.318825 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-e4503a74-ca7f-4f29-9450-1a20fb522799 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:09.320231 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-e4503a74-ca7f-4f29-9450-1a20fb522799 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] [instance: 016ea7a5-9bd1-4a28-baec-19dc96fd478c] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:09.328300 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-e4503a74-ca7f-4f29-9450-1a20fb522799 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:09.328752 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-e4503a74-ca7f-4f29-9450-1a20fb522799 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:09.329569 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-e4503a74-ca7f-4f29-9450-1a20fb522799 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:09.330093 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-e4503a74-ca7f-4f29-9450-1a20fb522799 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:09.575505 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-e4503a74-ca7f-4f29-9450-1a20fb522799 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c08c97c2fb446ba2d363c8a18d4958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31add21e55d4704b8285a700af04410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:09.585185 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-e4503a74-ca7f-4f29-9450-1a20fb522799 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] 10.222.0.45 "GET /compute/v2.1/servers/016ea7a5-9bd1-4a28-baec-19dc96fd478c" status: 200 len: 1463 microversion: 2.1 time: 0.270679 Aug 01 16:41:09.586173 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 116/225] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:09 2022] GET /compute/v2.1/servers/016ea7a5-9bd1-4a28-baec-19dc96fd478c => generated 1463 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:09.633244 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-964f73f7-f130-406b-8ea4-c6f50936e21c tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:09.633777 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-964f73f7-f130-406b-8ea4-c6f50936e21c tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] [instance: 016ea7a5-9bd1-4a28-baec-19dc96fd478c] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:09.640193 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-964f73f7-f130-406b-8ea4-c6f50936e21c tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:09.640636 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-964f73f7-f130-406b-8ea4-c6f50936e21c tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:09.641395 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-964f73f7-f130-406b-8ea4-c6f50936e21c tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:09.641896 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-964f73f7-f130-406b-8ea4-c6f50936e21c tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:09.668469 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-964f73f7-f130-406b-8ea4-c6f50936e21c tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] [instance: 016ea7a5-9bd1-4a28-baec-19dc96fd478c] Going to try to terminate instance {{(pid=118117) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 16:41:09.676976 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-1524d60f-5d25-4c6c-8e8f-020070cf646e tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:09.677909 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-1524d60f-5d25-4c6c-8e8f-020070cf646e tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] [instance: 348b2621-1bf9-431b-b639-9aabbf68a3cf] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:09.685783 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-1524d60f-5d25-4c6c-8e8f-020070cf646e tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:09.686675 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-1524d60f-5d25-4c6c-8e8f-020070cf646e tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:09.687634 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-1524d60f-5d25-4c6c-8e8f-020070cf646e tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:09.688256 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-1524d60f-5d25-4c6c-8e8f-020070cf646e tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:09.772354 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-964f73f7-f130-406b-8ea4-c6f50936e21c tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] 10.222.0.45 "DELETE /compute/v2.1/servers/016ea7a5-9bd1-4a28-baec-19dc96fd478c" status: 204 len: 0 microversion: 2.1 time: 0.142703 Aug 01 16:41:09.773292 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 110/226] 10.222.0.45 () {58 vars in 1239 bytes} [Mon Aug 1 16:41:09 2022] DELETE /compute/v2.1/servers/016ea7a5-9bd1-4a28-baec-19dc96fd478c => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 16:41:09.781680 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-9c438b07-e70d-477a-863b-60c1b6e57880 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:09.782918 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-9c438b07-e70d-477a-863b-60c1b6e57880 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:09.790397 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-9c438b07-e70d-477a-863b-60c1b6e57880 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:09.790851 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-9c438b07-e70d-477a-863b-60c1b6e57880 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:09.791702 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-9c438b07-e70d-477a-863b-60c1b6e57880 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:09.792232 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-9c438b07-e70d-477a-863b-60c1b6e57880 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:09.921067 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-1524d60f-5d25-4c6c-8e8f-020070cf646e tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a95d9f48c64b0fbb8879d361bc177d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019734069da44b2d88561549bd07544d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:09.930592 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-1524d60f-5d25-4c6c-8e8f-020070cf646e tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] 10.222.0.45 "GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf" status: 200 len: 1358 microversion: 2.1 time: 0.259612 Aug 01 16:41:09.931414 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 117/227] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:09 2022] GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf => generated 1358 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:09.936758 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-2d6fbdb7-a7c8-49e8-8fd4-4ebd8f147507 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:09.937336 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-2d6fbdb7-a7c8-49e8-8fd4-4ebd8f147507 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] [instance: 016ea7a5-9bd1-4a28-baec-19dc96fd478c] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:09.944333 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-2d6fbdb7-a7c8-49e8-8fd4-4ebd8f147507 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:09.945096 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-2d6fbdb7-a7c8-49e8-8fd4-4ebd8f147507 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:09.946083 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-2d6fbdb7-a7c8-49e8-8fd4-4ebd8f147507 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:09.946697 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-2d6fbdb7-a7c8-49e8-8fd4-4ebd8f147507 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:10.160436 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-9c438b07-e70d-477a-863b-60c1b6e57880 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:10.169506 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-9c438b07-e70d-477a-863b-60c1b6e57880 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:10.171564 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-9c438b07-e70d-477a-863b-60c1b6e57880 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:10.172989 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-9c438b07-e70d-477a-863b-60c1b6e57880 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1724 microversion: 2.20 time: 0.396061 Aug 01 16:41:10.173832 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 111/228] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:41:09 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1724 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:41:10.178484 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-ba75103f-e6be-4fd4-937e-9912a83916b1 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:10.179364 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-ba75103f-e6be-4fd4-937e-9912a83916b1 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:10.195705 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-ba75103f-e6be-4fd4-937e-9912a83916b1 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:10.196557 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-ba75103f-e6be-4fd4-937e-9912a83916b1 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:10.197904 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-ba75103f-e6be-4fd4-937e-9912a83916b1 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:10.198649 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-ba75103f-e6be-4fd4-937e-9912a83916b1 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:10.199897 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-2d6fbdb7-a7c8-49e8-8fd4-4ebd8f147507 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c08c97c2fb446ba2d363c8a18d4958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31add21e55d4704b8285a700af04410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:10.211251 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-2d6fbdb7-a7c8-49e8-8fd4-4ebd8f147507 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] 10.222.0.45 "GET /compute/v2.1/servers/016ea7a5-9bd1-4a28-baec-19dc96fd478c" status: 200 len: 1469 microversion: 2.1 time: 0.278425 Aug 01 16:41:10.212467 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 118/229] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:09 2022] GET /compute/v2.1/servers/016ea7a5-9bd1-4a28-baec-19dc96fd478c => generated 1469 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:10.364765 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-ba75103f-e6be-4fd4-937e-9912a83916b1 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:10.383597 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-ba75103f-e6be-4fd4-937e-9912a83916b1 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7" status: 200 len: 1502 microversion: 2.1 time: 0.208451 Aug 01 16:41:10.384218 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 112/230] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:10 2022] GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7 => generated 1502 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:10.415647 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-5ca761b3-d8c2-4bf3-98c6-b8999076fa5e tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:10.416573 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-5ca761b3-d8c2-4bf3-98c6-b8999076fa5e tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: ddf9be16-b3ce-411b-ac14-17dae5f41821] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:10.423851 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-5ca761b3-d8c2-4bf3-98c6-b8999076fa5e tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:10.424742 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-5ca761b3-d8c2-4bf3-98c6-b8999076fa5e tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:10.425813 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-5ca761b3-d8c2-4bf3-98c6-b8999076fa5e tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:10.426539 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-5ca761b3-d8c2-4bf3-98c6-b8999076fa5e tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:10.567331 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-c6e66771-b64f-4cae-8355-54c97ba54895 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "72f15c4b-9892-41ad-bfb0-687742df04c7"}} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:41:10.570209 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-c6e66771-b64f-4cae-8355-54c97ba54895 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 430702ec-add7-4d23-a875-36d09e281f0a] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:10.577419 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-c6e66771-b64f-4cae-8355-54c97ba54895 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:10.578040 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-c6e66771-b64f-4cae-8355-54c97ba54895 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:10.579528 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-c6e66771-b64f-4cae-8355-54c97ba54895 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:10.579528 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-c6e66771-b64f-4cae-8355-54c97ba54895 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:10.606208 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-5ca761b3-d8c2-4bf3-98c6-b8999076fa5e tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:10.616527 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-5ca761b3-d8c2-4bf3-98c6-b8999076fa5e tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/ddf9be16-b3ce-411b-ac14-17dae5f41821" status: 200 len: 1515 microversion: 2.1 time: 0.215609 Aug 01 16:41:10.617412 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 119/231] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:10 2022] GET /compute/v2.1/servers/ddf9be16-b3ce-411b-ac14-17dae5f41821 => generated 1515 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:10.954004 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-e7dae6f8-06e9-43e3-8376-85670d8c69f1 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:10.955252 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-e7dae6f8-06e9-43e3-8376-85670d8c69f1 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] [instance: 348b2621-1bf9-431b-b639-9aabbf68a3cf] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:10.964717 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-e7dae6f8-06e9-43e3-8376-85670d8c69f1 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:10.965856 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-e7dae6f8-06e9-43e3-8376-85670d8c69f1 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:10.967190 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-e7dae6f8-06e9-43e3-8376-85670d8c69f1 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:10.967793 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-e7dae6f8-06e9-43e3-8376-85670d8c69f1 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:11.133732 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-e7dae6f8-06e9-43e3-8376-85670d8c69f1 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a95d9f48c64b0fbb8879d361bc177d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019734069da44b2d88561549bd07544d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:11.142736 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-e7dae6f8-06e9-43e3-8376-85670d8c69f1 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] 10.222.0.45 "GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf" status: 200 len: 1358 microversion: 2.1 time: 0.192756 Aug 01 16:41:11.143293 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 120/232] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:10 2022] GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf => generated 1358 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:41:11.202739 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-233df443-582c-4830-91e6-9e3f49c682f0 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:11.203958 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-233df443-582c-4830-91e6-9e3f49c682f0 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:11.212594 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-233df443-582c-4830-91e6-9e3f49c682f0 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:11.213078 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-233df443-582c-4830-91e6-9e3f49c682f0 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:11.214652 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-233df443-582c-4830-91e6-9e3f49c682f0 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:11.215297 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-233df443-582c-4830-91e6-9e3f49c682f0 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:11.364405 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-233df443-582c-4830-91e6-9e3f49c682f0 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:11.385587 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-233df443-582c-4830-91e6-9e3f49c682f0 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:11.387400 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-233df443-582c-4830-91e6-9e3f49c682f0 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:11.388744 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-233df443-582c-4830-91e6-9e3f49c682f0 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1724 microversion: 2.20 time: 0.193310 Aug 01 16:41:11.399402 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 121/233] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:41:11 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1724 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:41:11.406847 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-52517095-2225-4bc0-ad6b-6d45445a4a73 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:11.407943 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-52517095-2225-4bc0-ad6b-6d45445a4a73 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] [instance: 016ea7a5-9bd1-4a28-baec-19dc96fd478c] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:11.418312 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-52517095-2225-4bc0-ad6b-6d45445a4a73 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:11.419090 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-52517095-2225-4bc0-ad6b-6d45445a4a73 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:11.420448 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-52517095-2225-4bc0-ad6b-6d45445a4a73 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:11.421296 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-52517095-2225-4bc0-ad6b-6d45445a4a73 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:11.574642 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-52517095-2225-4bc0-ad6b-6d45445a4a73 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c08c97c2fb446ba2d363c8a18d4958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31add21e55d4704b8285a700af04410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:11.583571 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-52517095-2225-4bc0-ad6b-6d45445a4a73 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] 10.222.0.45 "GET /compute/v2.1/servers/016ea7a5-9bd1-4a28-baec-19dc96fd478c" status: 200 len: 1469 microversion: 2.1 time: 0.182952 Aug 01 16:41:11.584343 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 122/234] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:11 2022] GET /compute/v2.1/servers/016ea7a5-9bd1-4a28-baec-19dc96fd478c => generated 1469 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:12.170145 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-f8fde352-53f4-4e70-a13e-acadbeab2f93 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:12.171505 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-f8fde352-53f4-4e70-a13e-acadbeab2f93 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] [instance: 348b2621-1bf9-431b-b639-9aabbf68a3cf] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:12.175062 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:41:12.192097 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-f8fde352-53f4-4e70-a13e-acadbeab2f93 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:12.192451 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-f8fde352-53f4-4e70-a13e-acadbeab2f93 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:12.194189 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-f8fde352-53f4-4e70-a13e-acadbeab2f93 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:12.194916 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-f8fde352-53f4-4e70-a13e-acadbeab2f93 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:12.324758 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-c6e66771-b64f-4cae-8355-54c97ba54895 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "POST /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.761800 Aug 01 16:41:12.325865 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 113/235] 10.222.0.45 () {60 vars in 1323 bytes} [Mon Aug 1 16:41:10 2022] POST /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a/os-volume_attachments => generated 194 bytes in 1764 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 16:41:12.332960 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-36e73898-f551-41d6-a5e4-5cb06db90e74 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:41:12.335559 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-36e73898-f551-41d6-a5e4-5cb06db90e74 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: ddf9be16-b3ce-411b-ac14-17dae5f41821] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:12.345279 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-36e73898-f551-41d6-a5e4-5cb06db90e74 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:12.347040 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-36e73898-f551-41d6-a5e4-5cb06db90e74 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:12.347712 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-36e73898-f551-41d6-a5e4-5cb06db90e74 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:12.348532 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-36e73898-f551-41d6-a5e4-5cb06db90e74 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:12.375044 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-f8fde352-53f4-4e70-a13e-acadbeab2f93 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a95d9f48c64b0fbb8879d361bc177d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019734069da44b2d88561549bd07544d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:12.377972 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.objects.instance [None req-36e73898-f551-41d6-a5e4-5cb06db90e74 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lazy-loading 'flavor' on Instance uuid ddf9be16-b3ce-411b-ac14-17dae5f41821 {{(pid=118117) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 16:41:12.384150 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-f8fde352-53f4-4e70-a13e-acadbeab2f93 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] 10.222.0.45 "GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf" status: 200 len: 1358 microversion: 2.1 time: 0.222602 Aug 01 16:41:12.384837 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 123/236] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:12 2022] GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf => generated 1358 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:12.413112 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-69ddd2fc-c7b6-4ab0-8bc7-e5a074741c54 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:12.413793 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-69ddd2fc-c7b6-4ab0-8bc7-e5a074741c54 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:12.420153 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-69ddd2fc-c7b6-4ab0-8bc7-e5a074741c54 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:12.420589 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-69ddd2fc-c7b6-4ab0-8bc7-e5a074741c54 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:12.421399 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-69ddd2fc-c7b6-4ab0-8bc7-e5a074741c54 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:12.421768 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-69ddd2fc-c7b6-4ab0-8bc7-e5a074741c54 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:12.424682 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_cell1:SELECT=100 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:41:12.485438 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-36e73898-f551-41d6-a5e4-5cb06db90e74 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "POST /compute/v2.1/servers/ddf9be16-b3ce-411b-ac14-17dae5f41821/action" status: 200 len: 32 microversion: 2.1 time: 0.148285 Aug 01 16:41:12.486983 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 114/237] 10.222.0.45 () {60 vars in 1278 bytes} [Mon Aug 1 16:41:12 2022] POST /compute/v2.1/servers/ddf9be16-b3ce-411b-ac14-17dae5f41821/action => generated 32 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 16:41:12.502395 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-26080cec-763b-47b5-9521-f80a00742248 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:12.504817 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-26080cec-763b-47b5-9521-f80a00742248 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: ddf9be16-b3ce-411b-ac14-17dae5f41821] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:12.521032 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-26080cec-763b-47b5-9521-f80a00742248 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:12.524153 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-26080cec-763b-47b5-9521-f80a00742248 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:12.525902 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-26080cec-763b-47b5-9521-f80a00742248 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:12.526314 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-26080cec-763b-47b5-9521-f80a00742248 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:12.620480 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-69ddd2fc-c7b6-4ab0-8bc7-e5a074741c54 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:12.630191 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-69ddd2fc-c7b6-4ab0-8bc7-e5a074741c54 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:12.631738 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-69ddd2fc-c7b6-4ab0-8bc7-e5a074741c54 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:12.633283 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-69ddd2fc-c7b6-4ab0-8bc7-e5a074741c54 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1724 microversion: 2.20 time: 0.223977 Aug 01 16:41:12.633833 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 124/238] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:41:12 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1724 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 16:41:12.641181 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-51777a35-518a-4064-bbf9-744f137e2500 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:12.642323 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-51777a35-518a-4064-bbf9-744f137e2500 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] [instance: 016ea7a5-9bd1-4a28-baec-19dc96fd478c] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:12.659465 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-51777a35-518a-4064-bbf9-744f137e2500 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:12.659961 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-51777a35-518a-4064-bbf9-744f137e2500 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:12.660813 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-51777a35-518a-4064-bbf9-744f137e2500 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:12.661328 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-51777a35-518a-4064-bbf9-744f137e2500 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:12.825321 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-26080cec-763b-47b5-9521-f80a00742248 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:12.834925 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-26080cec-763b-47b5-9521-f80a00742248 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/ddf9be16-b3ce-411b-ac14-17dae5f41821" status: 200 len: 1521 microversion: 2.1 time: 0.338794 Aug 01 16:41:12.835567 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 115/239] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:12 2022] GET /compute/v2.1/servers/ddf9be16-b3ce-411b-ac14-17dae5f41821 => generated 1521 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:12.842405 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-8829bb74-e1e6-4c0e-90d8-4b18d609113f tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2048245912", "imageRef": "c9cb5329-85cb-4472-935d-c4ea1d1f0592", "flavorRef": "452", "networks": [{"uuid": "ef5319c3-a335-4216-bb12-ed5b7339edb1"}]}} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:41:12.896507 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-51777a35-518a-4064-bbf9-744f137e2500 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c08c97c2fb446ba2d363c8a18d4958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31add21e55d4704b8285a700af04410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:12.905750 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-51777a35-518a-4064-bbf9-744f137e2500 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] 10.222.0.45 "GET /compute/v2.1/servers/016ea7a5-9bd1-4a28-baec-19dc96fd478c" status: 200 len: 1469 microversion: 2.1 time: 0.270754 Aug 01 16:41:12.906396 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 125/240] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:12 2022] GET /compute/v2.1/servers/016ea7a5-9bd1-4a28-baec-19dc96fd478c => generated 1469 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:12.909132 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.network.neutron [None req-8829bb74-e1e6-4c0e-90d8-4b18d609113f tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] validate_networks() for [('ef5319c3-a335-4216-bb12-ed5b7339edb1', None, None, None, None, None)] {{(pid=118117) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 16:41:13.296792 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [req-c9e707d7-a848-4575-9cdc-3753bbb7d479 req-40ea41d6-24af-43c3-98da-873c3705cafd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "348b2621-1bf9-431b-b639-9aabbf68a3cf", "name": "network-vif-plugged", "status": "completed", "tag": "8967f796-0a7a-4c6f-b2f7-18a05072b7c4"}]} {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:41:13.308343 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-c9e707d7-a848-4575-9cdc-3753bbb7d479 req-40ea41d6-24af-43c3-98da-873c3705cafd service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:13.309026 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-c9e707d7-a848-4575-9cdc-3753bbb7d479 req-40ea41d6-24af-43c3-98da-873c3705cafd service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:13.326410 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.compute.server_external_events [req-c9e707d7-a848-4575-9cdc-3753bbb7d479 req-40ea41d6-24af-43c3-98da-873c3705cafd service nova] Creating event network-vif-plugged:8967f796-0a7a-4c6f-b2f7-18a05072b7c4 for instance 348b2621-1bf9-431b-b639-9aabbf68a3cf on hv-cinder-85032 Aug 01 16:41:13.332764 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [req-c9e707d7-a848-4575-9cdc-3753bbb7d479 req-40ea41d6-24af-43c3-98da-873c3705cafd service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039351 Aug 01 16:41:13.333513 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 126/241] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:41:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 16:41:13.408473 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-fe735ea4-cd6a-4312-9d08-11b6fc721511 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:13.409378 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-fe735ea4-cd6a-4312-9d08-11b6fc721511 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] [instance: 348b2621-1bf9-431b-b639-9aabbf68a3cf] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:13.424428 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-fe735ea4-cd6a-4312-9d08-11b6fc721511 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:13.432392 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-fe735ea4-cd6a-4312-9d08-11b6fc721511 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:13.435968 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-fe735ea4-cd6a-4312-9d08-11b6fc721511 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:13.438713 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-fe735ea4-cd6a-4312-9d08-11b6fc721511 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:14.035945 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-fe735ea4-cd6a-4312-9d08-11b6fc721511 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a95d9f48c64b0fbb8879d361bc177d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019734069da44b2d88561549bd07544d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:14.044107 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-fe735ea4-cd6a-4312-9d08-11b6fc721511 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] 10.222.0.45 "GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf" status: 200 len: 1358 microversion: 2.1 time: 0.640747 Aug 01 16:41:14.045009 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 127/242] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:13 2022] GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf => generated 1358 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:41:14.050948 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-3bc27640-4419-4d72-b965-74816bbcf457 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:14.051557 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-3bc27640-4419-4d72-b965-74816bbcf457 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:14.058921 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3bc27640-4419-4d72-b965-74816bbcf457 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:14.059349 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3bc27640-4419-4d72-b965-74816bbcf457 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:14.060168 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3bc27640-4419-4d72-b965-74816bbcf457 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:14.060598 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3bc27640-4419-4d72-b965-74816bbcf457 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:14.171404 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.virt.hardware [None req-8829bb74-e1e6-4c0e-90d8-4b18d609113f tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Flavor limits 0:0:0 {{(pid=118117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 16:41:14.171404 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.virt.hardware [None req-8829bb74-e1e6-4c0e-90d8-4b18d609113f tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Image limits 0:0:0 {{(pid=118117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 16:41:14.172365 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.virt.hardware [None req-8829bb74-e1e6-4c0e-90d8-4b18d609113f tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Flavor pref 0:0:0 {{(pid=118117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 16:41:14.172365 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.virt.hardware [None req-8829bb74-e1e6-4c0e-90d8-4b18d609113f tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Image pref 0:0:0 {{(pid=118117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 16:41:14.172632 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.virt.hardware [None req-8829bb74-e1e6-4c0e-90d8-4b18d609113f tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 16:41:14.184807 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-8829bb74-e1e6-4c0e-90d8-4b18d609113f tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:14.185479 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-8829bb74-e1e6-4c0e-90d8-4b18d609113f tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:14.186427 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-8829bb74-e1e6-4c0e-90d8-4b18d609113f tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:14.187064 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-8829bb74-e1e6-4c0e-90d8-4b18d609113f tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:14.212076 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.quota [None req-8829bb74-e1e6-4c0e-90d8-4b18d609113f tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Getting quotas for project d08c78acd1db446bac4352f66e792085. Resources: {'cores', 'ram', 'instances'} {{(pid=118117) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 16:41:14.218709 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.quota [None req-8829bb74-e1e6-4c0e-90d8-4b18d609113f tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Getting quotas for user c6a8231119f34ef98b8a85303c5c447e and project d08c78acd1db446bac4352f66e792085. Resources: {'cores', 'ram', 'instances'} {{(pid=118117) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 16:41:14.246670 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-8829bb74-e1e6-4c0e-90d8-4b18d609113f tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Going to run 1 instances... {{(pid=118117) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 16:41:14.249739 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-8829bb74-e1e6-4c0e-90d8-4b18d609113f tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] [instance: 879465e3-1ea1-4193-aa67-f1648076f9c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c9cb5329-85cb-4472-935d-c4ea1d1f0592',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118117) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 16:41:14.327216 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-8829bb74-e1e6-4c0e-90d8-4b18d609113f tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.490299 Aug 01 16:41:14.332201 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 116/243] 10.222.0.45 () {60 vars in 1147 bytes} [Mon Aug 1 16:41:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1496 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 16:41:14.341006 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-0b52f6c6-1703-4f30-a0f3-e64999df4afe tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:14.343415 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-0b52f6c6-1703-4f30-a0f3-e64999df4afe tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: ddf9be16-b3ce-411b-ac14-17dae5f41821] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:14.356280 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-0b52f6c6-1703-4f30-a0f3-e64999df4afe tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:14.357809 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-0b52f6c6-1703-4f30-a0f3-e64999df4afe tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:14.358832 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-0b52f6c6-1703-4f30-a0f3-e64999df4afe tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:14.359471 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-0b52f6c6-1703-4f30-a0f3-e64999df4afe tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:14.471215 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-3bc27640-4419-4d72-b965-74816bbcf457 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:14.482861 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-3bc27640-4419-4d72-b965-74816bbcf457 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:14.484848 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-3bc27640-4419-4d72-b965-74816bbcf457 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:14.487033 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-3bc27640-4419-4d72-b965-74816bbcf457 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1724 microversion: 2.20 time: 0.440803 Aug 01 16:41:14.488015 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 128/244] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:41:14 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1724 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:41:14.494144 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-92cf8289-22c7-44bb-b5e8-21e5acbc0b7a tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:14.495216 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-92cf8289-22c7-44bb-b5e8-21e5acbc0b7a tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] [instance: 016ea7a5-9bd1-4a28-baec-19dc96fd478c] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:14.502589 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-92cf8289-22c7-44bb-b5e8-21e5acbc0b7a tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:14.503321 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-92cf8289-22c7-44bb-b5e8-21e5acbc0b7a tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:14.504332 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-92cf8289-22c7-44bb-b5e8-21e5acbc0b7a tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:14.505068 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-92cf8289-22c7-44bb-b5e8-21e5acbc0b7a tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:14.665583 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-0b52f6c6-1703-4f30-a0f3-e64999df4afe tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:14.675597 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-0b52f6c6-1703-4f30-a0f3-e64999df4afe tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/ddf9be16-b3ce-411b-ac14-17dae5f41821" status: 200 len: 1521 microversion: 2.1 time: 0.341875 Aug 01 16:41:14.680551 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 117/245] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:14 2022] GET /compute/v2.1/servers/ddf9be16-b3ce-411b-ac14-17dae5f41821 => generated 1521 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:14.692799 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-a0ac1c0b-a2e9-4a17-9451-ab563f870da2 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:14.693037 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-92cf8289-22c7-44bb-b5e8-21e5acbc0b7a tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c08c97c2fb446ba2d363c8a18d4958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31add21e55d4704b8285a700af04410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:14.693429 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-a0ac1c0b-a2e9-4a17-9451-ab563f870da2 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] [instance: 879465e3-1ea1-4193-aa67-f1648076f9c2] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:14.704536 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-92cf8289-22c7-44bb-b5e8-21e5acbc0b7a tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] 10.222.0.45 "GET /compute/v2.1/servers/016ea7a5-9bd1-4a28-baec-19dc96fd478c" status: 200 len: 1299 microversion: 2.1 time: 0.215223 Aug 01 16:41:14.705134 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 129/246] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:14 2022] GET /compute/v2.1/servers/016ea7a5-9bd1-4a28-baec-19dc96fd478c => generated 1299 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:14.709743 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [req-02b36b8e-37c9-429c-be0f-7bb1dedec0bb req-2b372283-053a-4cbd-a5e2-cdcb81299bbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "016ea7a5-9bd1-4a28-baec-19dc96fd478c", "name": "network-vif-deleted", "tag": "bfec3419-d211-4e0a-8a90-3c22626f6acb"}]} {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:41:14.720182 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-02b36b8e-37c9-429c-be0f-7bb1dedec0bb req-2b372283-053a-4cbd-a5e2-cdcb81299bbf service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:14.720602 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-02b36b8e-37c9-429c-be0f-7bb1dedec0bb req-2b372283-053a-4cbd-a5e2-cdcb81299bbf service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:14.734027 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.compute.server_external_events [req-02b36b8e-37c9-429c-be0f-7bb1dedec0bb req-2b372283-053a-4cbd-a5e2-cdcb81299bbf service nova] Creating event network-vif-deleted:bfec3419-d211-4e0a-8a90-3c22626f6acb for instance 016ea7a5-9bd1-4a28-baec-19dc96fd478c on hv-cinder-85032 Aug 01 16:41:14.739753 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [req-02b36b8e-37c9-429c-be0f-7bb1dedec0bb req-2b372283-053a-4cbd-a5e2-cdcb81299bbf service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033109 Aug 01 16:41:14.740491 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 130/247] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:41:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:41:14.756666 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-1bbfa726-1e0a-40f7-9cec-411fc518cc0c tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:41:14.765623 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-1bbfa726-1e0a-40f7-9cec-411fc518cc0c tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:14.766021 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-1bbfa726-1e0a-40f7-9cec-411fc518cc0c tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:14.796280 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-a0ac1c0b-a2e9-4a17-9451-ab563f870da2 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a8231119f34ef98b8a85303c5c447e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08c78acd1db446bac4352f66e792085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:14.805987 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-a0ac1c0b-a2e9-4a17-9451-ab563f870da2 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] 10.222.0.45 "GET /compute/v2.1/servers/879465e3-1ea1-4193-aa67-f1648076f9c2" status: 200 len: 1214 microversion: 2.1 time: 0.123212 Aug 01 16:41:14.806910 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 118/248] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:14 2022] GET /compute/v2.1/servers/879465e3-1ea1-4193-aa67-f1648076f9c2 => generated 1214 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:14.845232 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-1bbfa726-1e0a-40f7-9cec-411fc518cc0c tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: a3f6b512-e3cb-4e87-8d82-c64f6f1640db] Going to try to stop instance {{(pid=118118) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 01 16:41:14.894496 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-1bbfa726-1e0a-40f7-9cec-411fc518cc0c tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "POST /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db/action" status: 202 len: 0 microversion: 2.1 time: 0.141978 Aug 01 16:41:14.895051 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 131/249] 10.222.0.45 () {60 vars in 1278 bytes} [Mon Aug 1 16:41:14 2022] POST /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 16:41:14.903686 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-d2a66737-40df-4063-93f9-77716a60456c tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:14.904342 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-d2a66737-40df-4063-93f9-77716a60456c tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: a3f6b512-e3cb-4e87-8d82-c64f6f1640db] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:14.910568 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-d2a66737-40df-4063-93f9-77716a60456c tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:14.911238 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-d2a66737-40df-4063-93f9-77716a60456c tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:14.912221 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-d2a66737-40df-4063-93f9-77716a60456c tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:14.912646 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-d2a66737-40df-4063-93f9-77716a60456c tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:15.050397 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-d2a66737-40df-4063-93f9-77716a60456c tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0aed0278344119aae6906f4f52b1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b66d46c3e7d42b88f2dbdc01232fb03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:15.058896 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-d2a66737-40df-4063-93f9-77716a60456c tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db" status: 200 len: 1721 microversion: 2.1 time: 0.159337 Aug 01 16:41:15.069244 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 119/250] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:14 2022] GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:15.069437 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-aabcad58-640c-41b4-a92a-7d87009903f9 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:15.069437 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-aabcad58-640c-41b4-a92a-7d87009903f9 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] [instance: 348b2621-1bf9-431b-b639-9aabbf68a3cf] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:15.073857 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-aabcad58-640c-41b4-a92a-7d87009903f9 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:15.074306 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-aabcad58-640c-41b4-a92a-7d87009903f9 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:15.075105 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-aabcad58-640c-41b4-a92a-7d87009903f9 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:15.075528 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-aabcad58-640c-41b4-a92a-7d87009903f9 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:15.217365 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-aabcad58-640c-41b4-a92a-7d87009903f9 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a95d9f48c64b0fbb8879d361bc177d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019734069da44b2d88561549bd07544d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:15.225728 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-aabcad58-640c-41b4-a92a-7d87009903f9 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] 10.222.0.45 "GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf" status: 200 len: 1358 microversion: 2.1 time: 0.164170 Aug 01 16:41:15.226424 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 132/251] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:15 2022] GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:15.355388 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [req-732492f2-aaf6-4e00-8af3-077620d20143 req-a6b761b9-38eb-4afe-bfa5-9672ae3cc7c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "016ea7a5-9bd1-4a28-baec-19dc96fd478c", "name": "network-vif-unplugged", "status": "completed", "tag": "bfec3419-d211-4e0a-8a90-3c22626f6acb"}]} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:41:15.366746 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-732492f2-aaf6-4e00-8af3-077620d20143 req-a6b761b9-38eb-4afe-bfa5-9672ae3cc7c4 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:15.367247 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-732492f2-aaf6-4e00-8af3-077620d20143 req-a6b761b9-38eb-4afe-bfa5-9672ae3cc7c4 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:15.371531 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:41:15.381036 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.compute.server_external_events [req-732492f2-aaf6-4e00-8af3-077620d20143 req-a6b761b9-38eb-4afe-bfa5-9672ae3cc7c4 service nova] Creating event network-vif-unplugged:bfec3419-d211-4e0a-8a90-3c22626f6acb for instance 016ea7a5-9bd1-4a28-baec-19dc96fd478c on hv-cinder-85032 Aug 01 16:41:15.388036 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [req-732492f2-aaf6-4e00-8af3-077620d20143 req-a6b761b9-38eb-4afe-bfa5-9672ae3cc7c4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036237 Aug 01 16:41:15.388919 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 120/252] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:41:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:41:15.514815 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-d6822e66-8b78-4812-9501-f9614c2074f1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:15.515423 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-d6822e66-8b78-4812-9501-f9614c2074f1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:15.522496 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-d6822e66-8b78-4812-9501-f9614c2074f1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:15.522932 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-d6822e66-8b78-4812-9501-f9614c2074f1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:15.523712 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-d6822e66-8b78-4812-9501-f9614c2074f1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:15.524186 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-d6822e66-8b78-4812-9501-f9614c2074f1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:15.666097 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-d6822e66-8b78-4812-9501-f9614c2074f1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:15.686182 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-d6822e66-8b78-4812-9501-f9614c2074f1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:15.687666 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-d6822e66-8b78-4812-9501-f9614c2074f1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:15.688843 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-d6822e66-8b78-4812-9501-f9614c2074f1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1724 microversion: 2.20 time: 0.178071 Aug 01 16:41:15.699088 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-a7a3b759-930d-4458-9c10-1513e9e3ac05 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:15.700665 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-a7a3b759-930d-4458-9c10-1513e9e3ac05 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: ddf9be16-b3ce-411b-ac14-17dae5f41821] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:15.701551 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 133/253] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:41:15 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1724 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:41:15.708883 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-a7a3b759-930d-4458-9c10-1513e9e3ac05 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:15.709468 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-a7a3b759-930d-4458-9c10-1513e9e3ac05 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:15.710352 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-a7a3b759-930d-4458-9c10-1513e9e3ac05 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:15.710915 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-a7a3b759-930d-4458-9c10-1513e9e3ac05 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:15.725732 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-37624740-2409-44a9-a87b-87ad9ed8c89d tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:15.726597 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-37624740-2409-44a9-a87b-87ad9ed8c89d tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] [instance: 016ea7a5-9bd1-4a28-baec-19dc96fd478c] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:15.733048 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-37624740-2409-44a9-a87b-87ad9ed8c89d tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:15.733476 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-37624740-2409-44a9-a87b-87ad9ed8c89d tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:15.734228 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-37624740-2409-44a9-a87b-87ad9ed8c89d tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:15.734646 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-37624740-2409-44a9-a87b-87ad9ed8c89d tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:15.870974 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-a7a3b759-930d-4458-9c10-1513e9e3ac05 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:15.887415 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-a7a3b759-930d-4458-9c10-1513e9e3ac05 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/ddf9be16-b3ce-411b-ac14-17dae5f41821" status: 200 len: 1521 microversion: 2.1 time: 0.192340 Aug 01 16:41:15.888593 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 121/254] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:15 2022] GET /compute/v2.1/servers/ddf9be16-b3ce-411b-ac14-17dae5f41821 => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:15.894831 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-6025d50f-abca-4c4f-aa00-a788b064d18b tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:15.895752 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-6025d50f-abca-4c4f-aa00-a788b064d18b tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] [instance: 879465e3-1ea1-4193-aa67-f1648076f9c2] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:15.902834 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-6025d50f-abca-4c4f-aa00-a788b064d18b tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:15.903488 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-6025d50f-abca-4c4f-aa00-a788b064d18b tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:15.904529 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-6025d50f-abca-4c4f-aa00-a788b064d18b tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:15.905104 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-6025d50f-abca-4c4f-aa00-a788b064d18b tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:15.928697 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-37624740-2409-44a9-a87b-87ad9ed8c89d tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:15.929458 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-37624740-2409-44a9-a87b-87ad9ed8c89d tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:15.930240 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.objects.instance [None req-37624740-2409-44a9-a87b-87ad9ed8c89d tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lazy-loading 'fault' on Instance uuid 016ea7a5-9bd1-4a28-baec-19dc96fd478c {{(pid=118118) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 16:41:15.995158 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-6025d50f-abca-4c4f-aa00-a788b064d18b tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a8231119f34ef98b8a85303c5c447e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08c78acd1db446bac4352f66e792085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:16.006431 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-6025d50f-abca-4c4f-aa00-a788b064d18b tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] 10.222.0.45 "GET /compute/v2.1/servers/879465e3-1ea1-4193-aa67-f1648076f9c2" status: 200 len: 1210 microversion: 2.1 time: 0.116365 Aug 01 16:41:16.008321 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 122/255] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:15 2022] GET /compute/v2.1/servers/879465e3-1ea1-4193-aa67-f1648076f9c2 => generated 1210 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:16.015208 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-37624740-2409-44a9-a87b-87ad9ed8c89d tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4c08c97c2fb446ba2d363c8a18d4958', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c31add21e55d4704b8285a700af04410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:16.023811 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-37624740-2409-44a9-a87b-87ad9ed8c89d tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] 10.222.0.45 "GET /compute/v2.1/servers/016ea7a5-9bd1-4a28-baec-19dc96fd478c" status: 200 len: 1304 microversion: 2.1 time: 0.302323 Aug 01 16:41:16.024701 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 134/256] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:15 2022] GET /compute/v2.1/servers/016ea7a5-9bd1-4a28-baec-19dc96fd478c => generated 1304 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:41:16.081211 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-734eeed9-c0d8-45fa-b315-cc0865f97daa tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:16.081820 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-734eeed9-c0d8-45fa-b315-cc0865f97daa tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: a3f6b512-e3cb-4e87-8d82-c64f6f1640db] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:16.088081 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-734eeed9-c0d8-45fa-b315-cc0865f97daa tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:16.088524 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-734eeed9-c0d8-45fa-b315-cc0865f97daa tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:16.089266 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-734eeed9-c0d8-45fa-b315-cc0865f97daa tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:16.089694 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-734eeed9-c0d8-45fa-b315-cc0865f97daa tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:16.223622 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-734eeed9-c0d8-45fa-b315-cc0865f97daa tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0aed0278344119aae6906f4f52b1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b66d46c3e7d42b88f2dbdc01232fb03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:16.232199 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-734eeed9-c0d8-45fa-b315-cc0865f97daa tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db" status: 200 len: 1721 microversion: 2.1 time: 0.154926 Aug 01 16:41:16.232772 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 123/257] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:16 2022] GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:16.247012 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-6091fd6f-1ce8-4e7b-99c1-a23b5939c8af tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:16.247484 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-6091fd6f-1ce8-4e7b-99c1-a23b5939c8af tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] [instance: 348b2621-1bf9-431b-b639-9aabbf68a3cf] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:16.253887 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-6091fd6f-1ce8-4e7b-99c1-a23b5939c8af tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:16.254325 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-6091fd6f-1ce8-4e7b-99c1-a23b5939c8af tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:16.255078 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-6091fd6f-1ce8-4e7b-99c1-a23b5939c8af tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:16.255498 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-6091fd6f-1ce8-4e7b-99c1-a23b5939c8af tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:16.474587 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-6091fd6f-1ce8-4e7b-99c1-a23b5939c8af tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a95d9f48c64b0fbb8879d361bc177d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019734069da44b2d88561549bd07544d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:16.483740 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-6091fd6f-1ce8-4e7b-99c1-a23b5939c8af tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] 10.222.0.45 "GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf" status: 200 len: 1548 microversion: 2.1 time: 0.240876 Aug 01 16:41:16.484331 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 135/258] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:16 2022] GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf => generated 1548 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:16.508021 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-5901d6c0-1435-44dd-af2b-607d5602c220 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:16.509258 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-5901d6c0-1435-44dd-af2b-607d5602c220 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] [instance: 348b2621-1bf9-431b-b639-9aabbf68a3cf] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:16.516206 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-5901d6c0-1435-44dd-af2b-607d5602c220 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:16.516916 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-5901d6c0-1435-44dd-af2b-607d5602c220 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:16.517701 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-5901d6c0-1435-44dd-af2b-607d5602c220 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:16.518215 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-5901d6c0-1435-44dd-af2b-607d5602c220 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:16.727600 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-8b0fb06d-b9e1-42c3-ae97-166adffdc9b1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:16.728658 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-8b0fb06d-b9e1-42c3-ae97-166adffdc9b1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:16.736516 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-8b0fb06d-b9e1-42c3-ae97-166adffdc9b1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:16.737634 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-8b0fb06d-b9e1-42c3-ae97-166adffdc9b1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:16.739143 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-8b0fb06d-b9e1-42c3-ae97-166adffdc9b1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:16.739621 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-8b0fb06d-b9e1-42c3-ae97-166adffdc9b1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:16.763175 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-5901d6c0-1435-44dd-af2b-607d5602c220 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a95d9f48c64b0fbb8879d361bc177d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019734069da44b2d88561549bd07544d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:16.772731 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-5901d6c0-1435-44dd-af2b-607d5602c220 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] 10.222.0.45 "GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf" status: 200 len: 1548 microversion: 2.1 time: 0.268490 Aug 01 16:41:16.774189 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 124/259] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:16 2022] GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf => generated 1548 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:16.793786 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-f0875a52-7df7-4cd6-9e21-153a58913788 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:16.798936 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-f0875a52-7df7-4cd6-9e21-153a58913788 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '23a95d9f48c64b0fbb8879d361bc177d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019734069da44b2d88561549bd07544d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:16.799708 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-f0875a52-7df7-4cd6-9e21-153a58913788 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Searching by: {'deleted': False, 'project_id': '019734069da44b2d88561549bd07544d'} {{(pid=118117) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 01 16:41:16.806696 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-f0875a52-7df7-4cd6-9e21-153a58913788 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:16.807136 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-f0875a52-7df7-4cd6-9e21-153a58913788 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:16.807955 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-f0875a52-7df7-4cd6-9e21-153a58913788 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:16.808382 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-f0875a52-7df7-4cd6-9e21-153a58913788 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:16.901363 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.multi_cell_list [None req-f0875a52-7df7-4cd6-9e21-153a58913788 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118117) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 01 16:41:16.974896 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-8b0fb06d-b9e1-42c3-ae97-166adffdc9b1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:16.983215 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-8b0fb06d-b9e1-42c3-ae97-166adffdc9b1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:16.984777 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-8b0fb06d-b9e1-42c3-ae97-166adffdc9b1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:16.986475 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-8b0fb06d-b9e1-42c3-ae97-166adffdc9b1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1724 microversion: 2.20 time: 0.265256 Aug 01 16:41:16.987194 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 136/260] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:41:16 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1724 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:41:16.992278 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-6ac340a1-8ed1-423c-8976-c2d2a21acf96 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:16.993311 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-6ac340a1-8ed1-423c-8976-c2d2a21acf96 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: ddf9be16-b3ce-411b-ac14-17dae5f41821] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:16.999843 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-f0875a52-7df7-4cd6-9e21-153a58913788 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] 10.222.0.45 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.209798 Aug 01 16:41:17.000197 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-6ac340a1-8ed1-423c-8976-c2d2a21acf96 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:17.001324 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-6ac340a1-8ed1-423c-8976-c2d2a21acf96 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:17.002586 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-6ac340a1-8ed1-423c-8976-c2d2a21acf96 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:17.003207 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-6ac340a1-8ed1-423c-8976-c2d2a21acf96 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:17.007481 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 125/261] 10.222.0.45 () {58 vars in 1125 bytes} [Mon Aug 1 16:41:16 2022] GET /compute/v2.1/servers => generated 343 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 16:41:17.012678 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-7d00d833-ca1a-41a3-b7a3-ef0ba37f4395 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:17.013506 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-7d00d833-ca1a-41a3-b7a3-ef0ba37f4395 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] [instance: 348b2621-1bf9-431b-b639-9aabbf68a3cf] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:17.021795 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-7d00d833-ca1a-41a3-b7a3-ef0ba37f4395 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:17.022246 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-7d00d833-ca1a-41a3-b7a3-ef0ba37f4395 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:17.023353 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-7d00d833-ca1a-41a3-b7a3-ef0ba37f4395 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:17.023907 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-7d00d833-ca1a-41a3-b7a3-ef0ba37f4395 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:17.344918 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-6ac340a1-8ed1-423c-8976-c2d2a21acf96 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:17.348224 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-7d00d833-ca1a-41a3-b7a3-ef0ba37f4395 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a95d9f48c64b0fbb8879d361bc177d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019734069da44b2d88561549bd07544d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:17.354163 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-6ac340a1-8ed1-423c-8976-c2d2a21acf96 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/ddf9be16-b3ce-411b-ac14-17dae5f41821" status: 200 len: 1521 microversion: 2.1 time: 0.365622 Aug 01 16:41:17.354871 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 137/262] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:16 2022] GET /compute/v2.1/servers/ddf9be16-b3ce-411b-ac14-17dae5f41821 => generated 1521 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:17.358371 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-7d00d833-ca1a-41a3-b7a3-ef0ba37f4395 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] 10.222.0.45 "GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf" status: 200 len: 1548 microversion: 2.1 time: 0.349453 Aug 01 16:41:17.359346 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 126/263] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:17 2022] GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf => generated 1548 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:17.359709 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-4a9a57cb-8446-4e71-ab51-4c74f30ba5f8 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:17.360442 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-4a9a57cb-8446-4e71-ab51-4c74f30ba5f8 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] [instance: 879465e3-1ea1-4193-aa67-f1648076f9c2] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:17.367130 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-4a9a57cb-8446-4e71-ab51-4c74f30ba5f8 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:17.367313 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-d494c806-8b0d-4c01-a459-16521de83c46 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:17.367840 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-d494c806-8b0d-4c01-a459-16521de83c46 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] [instance: 016ea7a5-9bd1-4a28-baec-19dc96fd478c] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:17.368305 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-4a9a57cb-8446-4e71-ab51-4c74f30ba5f8 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:17.369375 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-4a9a57cb-8446-4e71-ab51-4c74f30ba5f8 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:17.369760 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-4a9a57cb-8446-4e71-ab51-4c74f30ba5f8 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:17.378754 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-d494c806-8b0d-4c01-a459-16521de83c46 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:17.387890 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-d494c806-8b0d-4c01-a459-16521de83c46 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:17.388742 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-d494c806-8b0d-4c01-a459-16521de83c46 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:17.389468 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-d494c806-8b0d-4c01-a459-16521de83c46 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:17.407295 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.wsgi [None req-d494c806-8b0d-4c01-a459-16521de83c46 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] HTTP exception thrown: Instance 016ea7a5-9bd1-4a28-baec-19dc96fd478c could not be found. Aug 01 16:41:17.408982 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-d494c806-8b0d-4c01-a459-16521de83c46 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Request method failure captured: Aug 01 16:41:17.408982 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: request: GET /compute/v2.1/servers/016ea7a5-9bd1-4a28-baec-19dc96fd478c HTTP/1.1 Aug 01 16:41:17.408982 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Accept: application/json Aug 01 16:41:17.408982 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Accept-Encoding: identity Aug 01 16:41:17.408982 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Connection: close Aug 01 16:41:17.408982 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Content-Length: 0 Aug 01 16:41:17.408982 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Content-Type: application/json Aug 01 16:41:17.408982 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Host: 10.222.0.45 Aug 01 16:41:17.408982 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Openstack-System-Scope: None Aug 01 16:41:17.408982 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: User-Agent: python-urllib3/1.26.10 Aug 01 16:41:17.408982 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Auth-Token: gAAAAABi6AIK_5UOybY78vLfDBU3lzOdQUtnNdpkFm5f46KGUA3F5cxXk3zXQCW1UCHQpBdljrLGn-4bkAV0cB_7Ite-q4ai4HbfLMxPHjtL41j_X4YXwu7aWlsby54qbnkBV0sQLvT4fRTX-RpuIjD33IzAXTygLbinOG5KCetCaZb2ZMY47_8 Aug 01 16:41:17.408982 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Domain-Id: None Aug 01 16:41:17.408982 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Domain-Name: None Aug 01 16:41:17.408982 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Identity-Status: Confirmed Aug 01 16:41:17.408982 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Is-Admin-Project: True Aug 01 16:41:17.408982 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Domain-Id: default Aug 01 16:41:17.408982 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Domain-Name: Default Aug 01 16:41:17.408982 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Id: c31add21e55d4704b8285a700af04410 Aug 01 16:41:17.408982 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Name: tempest-VolumesNegativeTest-813769279 Aug 01 16:41:17.408982 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Role: reader,member Aug 01 16:41:17.408982 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Roles: reader,member Aug 01 16:41:17.410496 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c31add21e55d4704b8285a700af04410"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c31add21e55d4704b8285a700af04410"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c31add21e55d4704b8285a700af04410"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c31add21e55d4704b8285a700af04410"}]}] Aug 01 16:41:17.410496 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Tenant: tempest-VolumesNegativeTest-813769279 Aug 01 16:41:17.410496 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Tenant-Id: c31add21e55d4704b8285a700af04410 Aug 01 16:41:17.410496 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Tenant-Name: tempest-VolumesNegativeTest-813769279 Aug 01 16:41:17.410496 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User: tempest-VolumesNegativeTest-813769279-project Aug 01 16:41:17.410496 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Domain-Id: default Aug 01 16:41:17.410496 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Domain-Name: Default Aug 01 16:41:17.410496 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Id: c4c08c97c2fb446ba2d363c8a18d4958 Aug 01 16:41:17.410496 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Name: tempest-VolumesNegativeTest-813769279-project Aug 01 16:41:17.410496 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: method: > Aug 01 16:41:17.410496 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: exception: Instance 016ea7a5-9bd1-4a28-baec-19dc96fd478c could not be found. Aug 01 16:41:17.410496 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: action_args: {'id': '016ea7a5-9bd1-4a28-baec-19dc96fd478c'} Aug 01 16:41:17.411335 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:41:17.411335 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:41:17.411335 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 16:41:17.411335 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 16:41:17.411335 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 16:41:17.411335 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 16:41:17.411335 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 16:41:17.411335 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 16:41:17.411335 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 16:41:17.411335 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 16:41:17.411335 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 016ea7a5-9bd1-4a28-baec-19dc96fd478c could not be found. Aug 01 16:41:17.411335 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:41:17.411335 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:41:17.411335 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:41:17.411335 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:41:17.411335 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:41:17.411335 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:41:17.411335 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:41:17.411335 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:41:17.411335 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:41:17.413268 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:41:17.413268 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 16:41:17.413268 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 16:41:17.413268 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 16:41:17.413268 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 16:41:17.413268 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 16:41:17.413268 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:41:17.413268 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 016ea7a5-9bd1-4a28-baec-19dc96fd478c could not be found. Aug 01 16:41:17.413268 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:41:17.413268 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:41:17.413268 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:41:17.413268 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:41:17.413268 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:41:17.413268 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:41:17.413268 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:41:17.413268 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:41:17.413268 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 016ea7a5-9bd1-4a28-baec-19dc96fd478c could not be found. Aug 01 16:41:17.413268 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:41:17.414976 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-d494c806-8b0d-4c01-a459-16521de83c46 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] Returning 404 to user: Instance 016ea7a5-9bd1-4a28-baec-19dc96fd478c could not be found. {{(pid=118117) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:41:17.414976 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-d494c806-8b0d-4c01-a459-16521de83c46 tempest-VolumesNegativeTest-813769279 tempest-VolumesNegativeTest-813769279-project] 10.222.0.45 "GET /compute/v2.1/servers/016ea7a5-9bd1-4a28-baec-19dc96fd478c" status: 404 len: 111 microversion: 2.1 time: 0.049227 Aug 01 16:41:17.414976 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 127/264] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:17 2022] GET /compute/v2.1/servers/016ea7a5-9bd1-4a28-baec-19dc96fd478c => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 16:41:17.421695 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-cc19be13-2695-4992-84ed-6a76bbca2670 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:17.424664 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-cc19be13-2695-4992-84ed-6a76bbca2670 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: a3f6b512-e3cb-4e87-8d82-c64f6f1640db] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:17.437888 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-cc19be13-2695-4992-84ed-6a76bbca2670 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:17.439539 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-cc19be13-2695-4992-84ed-6a76bbca2670 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:17.439730 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-cc19be13-2695-4992-84ed-6a76bbca2670 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:17.446596 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-cc19be13-2695-4992-84ed-6a76bbca2670 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:17.477934 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-4a9a57cb-8446-4e71-ab51-4c74f30ba5f8 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a8231119f34ef98b8a85303c5c447e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08c78acd1db446bac4352f66e792085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:17.487236 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-4a9a57cb-8446-4e71-ab51-4c74f30ba5f8 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] 10.222.0.45 "GET /compute/v2.1/servers/879465e3-1ea1-4193-aa67-f1648076f9c2" status: 200 len: 1272 microversion: 2.1 time: 0.131178 Aug 01 16:41:17.491229 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 138/265] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:17 2022] GET /compute/v2.1/servers/879465e3-1ea1-4193-aa67-f1648076f9c2 => generated 1272 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:17.743558 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-cc19be13-2695-4992-84ed-6a76bbca2670 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0aed0278344119aae6906f4f52b1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b66d46c3e7d42b88f2dbdc01232fb03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:17.757091 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-cc19be13-2695-4992-84ed-6a76bbca2670 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db" status: 200 len: 1721 microversion: 2.1 time: 0.344819 Aug 01 16:41:17.757679 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 128/266] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:17 2022] GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db => generated 1721 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:18.012121 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-c7ad5f0c-6739-4fae-ac38-6dc8b1404ad6 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:18.012946 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-c7ad5f0c-6739-4fae-ac38-6dc8b1404ad6 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:18.024725 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-c7ad5f0c-6739-4fae-ac38-6dc8b1404ad6 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:18.025174 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-c7ad5f0c-6739-4fae-ac38-6dc8b1404ad6 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:18.025997 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-c7ad5f0c-6739-4fae-ac38-6dc8b1404ad6 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:18.026374 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-c7ad5f0c-6739-4fae-ac38-6dc8b1404ad6 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:18.376398 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-8f7c26d7-2922-4446-9416-6a5fc7cf1678 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:18.377044 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-8f7c26d7-2922-4446-9416-6a5fc7cf1678 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: ddf9be16-b3ce-411b-ac14-17dae5f41821] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:18.380577 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-c7ad5f0c-6739-4fae-ac38-6dc8b1404ad6 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:18.389038 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-8f7c26d7-2922-4446-9416-6a5fc7cf1678 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:18.389766 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-8f7c26d7-2922-4446-9416-6a5fc7cf1678 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:18.390495 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-c7ad5f0c-6739-4fae-ac38-6dc8b1404ad6 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:18.390611 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-8f7c26d7-2922-4446-9416-6a5fc7cf1678 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:18.390963 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-8f7c26d7-2922-4446-9416-6a5fc7cf1678 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:18.392438 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-c7ad5f0c-6739-4fae-ac38-6dc8b1404ad6 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:18.394580 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-c7ad5f0c-6739-4fae-ac38-6dc8b1404ad6 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1724 microversion: 2.20 time: 0.386261 Aug 01 16:41:18.408555 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 139/267] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:41:18 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1724 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:41:18.520596 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-49a4f991-661f-407f-b723-e178dd510e79 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:18.521645 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-49a4f991-661f-407f-b723-e178dd510e79 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] [instance: 879465e3-1ea1-4193-aa67-f1648076f9c2] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:18.536121 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-49a4f991-661f-407f-b723-e178dd510e79 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:18.536874 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-49a4f991-661f-407f-b723-e178dd510e79 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:18.539888 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-49a4f991-661f-407f-b723-e178dd510e79 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:18.540768 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-49a4f991-661f-407f-b723-e178dd510e79 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:18.760899 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-8f7c26d7-2922-4446-9416-6a5fc7cf1678 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:18.771719 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-8f7c26d7-2922-4446-9416-6a5fc7cf1678 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/ddf9be16-b3ce-411b-ac14-17dae5f41821" status: 200 len: 1521 microversion: 2.1 time: 0.399255 Aug 01 16:41:18.772609 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 129/268] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:18 2022] GET /compute/v2.1/servers/ddf9be16-b3ce-411b-ac14-17dae5f41821 => generated 1521 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:41:18.791465 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-f08a1160-a272-42b1-829a-76f5b91a1c90 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:18.793067 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-f08a1160-a272-42b1-829a-76f5b91a1c90 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: a3f6b512-e3cb-4e87-8d82-c64f6f1640db] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:18.804896 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-f08a1160-a272-42b1-829a-76f5b91a1c90 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:18.805628 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-f08a1160-a272-42b1-829a-76f5b91a1c90 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:18.806425 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-f08a1160-a272-42b1-829a-76f5b91a1c90 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:18.806838 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-f08a1160-a272-42b1-829a-76f5b91a1c90 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:18.887784 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-49a4f991-661f-407f-b723-e178dd510e79 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a8231119f34ef98b8a85303c5c447e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08c78acd1db446bac4352f66e792085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:18.890009 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:41:18.905682 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-49a4f991-661f-407f-b723-e178dd510e79 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] 10.222.0.45 "GET /compute/v2.1/servers/879465e3-1ea1-4193-aa67-f1648076f9c2" status: 200 len: 1314 microversion: 2.1 time: 0.392447 Aug 01 16:41:18.919810 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 140/269] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:18 2022] GET /compute/v2.1/servers/879465e3-1ea1-4193-aa67-f1648076f9c2 => generated 1314 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:19.096749 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-f08a1160-a272-42b1-829a-76f5b91a1c90 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0aed0278344119aae6906f4f52b1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b66d46c3e7d42b88f2dbdc01232fb03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:19.117483 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-f08a1160-a272-42b1-829a-76f5b91a1c90 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db" status: 200 len: 1721 microversion: 2.1 time: 0.338030 Aug 01 16:41:19.118887 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 130/270] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:18 2022] GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db => generated 1721 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:41:19.195831 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [req-14e02fc8-62fb-4f3e-a8ea-f3d7cc0d23ea req-ce7d8743-947e-4eb2-91a0-12800177f120 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "879465e3-1ea1-4193-aa67-f1648076f9c2", "tag": "90beeb8e-5d34-4a76-bb5b-966b9ac81523"}]} {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:41:19.210441 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-14e02fc8-62fb-4f3e-a8ea-f3d7cc0d23ea req-ce7d8743-947e-4eb2-91a0-12800177f120 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:19.211174 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-14e02fc8-62fb-4f3e-a8ea-f3d7cc0d23ea req-ce7d8743-947e-4eb2-91a0-12800177f120 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:19.225321 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.compute.server_external_events [req-14e02fc8-62fb-4f3e-a8ea-f3d7cc0d23ea req-ce7d8743-947e-4eb2-91a0-12800177f120 service nova] Creating event network-changed:90beeb8e-5d34-4a76-bb5b-966b9ac81523 for instance 879465e3-1ea1-4193-aa67-f1648076f9c2 on hv-cinder-85032 Aug 01 16:41:19.244232 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [req-14e02fc8-62fb-4f3e-a8ea-f3d7cc0d23ea req-ce7d8743-947e-4eb2-91a0-12800177f120 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052764 Aug 01 16:41:19.244845 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 141/271] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:41:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:41:19.276283 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-8e2bef28-a3d6-401a-8d1e-6faffd2c07db tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ce3f0300-4d63-424d-a4e8-bdd57c52ba7b"}} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:41:19.278576 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-8e2bef28-a3d6-401a-8d1e-6faffd2c07db tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] [instance: 348b2621-1bf9-431b-b639-9aabbf68a3cf] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:19.284912 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-8e2bef28-a3d6-401a-8d1e-6faffd2c07db tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:19.285348 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-8e2bef28-a3d6-401a-8d1e-6faffd2c07db tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:19.286107 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-8e2bef28-a3d6-401a-8d1e-6faffd2c07db tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:19.286526 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-8e2bef28-a3d6-401a-8d1e-6faffd2c07db tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:19.429574 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-00482eaa-3d01-4efa-bee1-83e4fd2cbcae tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:19.433721 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-00482eaa-3d01-4efa-bee1-83e4fd2cbcae tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:19.447581 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-00482eaa-3d01-4efa-bee1-83e4fd2cbcae tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:19.448072 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-00482eaa-3d01-4efa-bee1-83e4fd2cbcae tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:19.448885 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-00482eaa-3d01-4efa-bee1-83e4fd2cbcae tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:19.449343 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-00482eaa-3d01-4efa-bee1-83e4fd2cbcae tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:19.709154 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-00482eaa-3d01-4efa-bee1-83e4fd2cbcae tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:19.722800 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-00482eaa-3d01-4efa-bee1-83e4fd2cbcae tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:19.726285 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-00482eaa-3d01-4efa-bee1-83e4fd2cbcae tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:19.728076 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-00482eaa-3d01-4efa-bee1-83e4fd2cbcae tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1724 microversion: 2.20 time: 0.313021 Aug 01 16:41:19.728640 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 142/272] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:41:19 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1724 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:41:19.801616 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-ac8dba21-5a93-4cee-ab61-66b320ea32bd tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:19.802359 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-8e2bef28-a3d6-401a-8d1e-6faffd2c07db tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] 10.222.0.45 "POST /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.529692 Aug 01 16:41:19.803626 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-ac8dba21-5a93-4cee-ab61-66b320ea32bd tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: ddf9be16-b3ce-411b-ac14-17dae5f41821] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:19.810045 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 131/273] 10.222.0.45 () {60 vars in 1323 bytes} [Mon Aug 1 16:41:19 2022] POST /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf/os-volume_attachments => generated 194 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 16:41:19.818185 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-ac8dba21-5a93-4cee-ab61-66b320ea32bd tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:19.818651 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-ac8dba21-5a93-4cee-ab61-66b320ea32bd tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:19.819391 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-ac8dba21-5a93-4cee-ab61-66b320ea32bd tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:19.822459 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-ac8dba21-5a93-4cee-ab61-66b320ea32bd tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:19.941365 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-787498ed-f493-4445-bf42-5448ca153941 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:19.942098 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-787498ed-f493-4445-bf42-5448ca153941 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] [instance: 879465e3-1ea1-4193-aa67-f1648076f9c2] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:19.951748 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-787498ed-f493-4445-bf42-5448ca153941 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:19.952487 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-787498ed-f493-4445-bf42-5448ca153941 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:19.954416 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-787498ed-f493-4445-bf42-5448ca153941 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:19.955244 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-787498ed-f493-4445-bf42-5448ca153941 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:20.266697 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-ac8dba21-5a93-4cee-ab61-66b320ea32bd tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:20.281630 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-ac8dba21-5a93-4cee-ab61-66b320ea32bd tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/ddf9be16-b3ce-411b-ac14-17dae5f41821" status: 200 len: 1521 microversion: 2.1 time: 0.492008 Aug 01 16:41:20.282274 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 143/274] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:19 2022] GET /compute/v2.1/servers/ddf9be16-b3ce-411b-ac14-17dae5f41821 => generated 1521 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:41:20.304128 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-7b2a9362-ffcd-4306-af82-c47ba9bd5c03 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:20.304737 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-7b2a9362-ffcd-4306-af82-c47ba9bd5c03 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: a3f6b512-e3cb-4e87-8d82-c64f6f1640db] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:20.311891 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-7b2a9362-ffcd-4306-af82-c47ba9bd5c03 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:20.312501 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-7b2a9362-ffcd-4306-af82-c47ba9bd5c03 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:20.313764 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-7b2a9362-ffcd-4306-af82-c47ba9bd5c03 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:20.314516 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-7b2a9362-ffcd-4306-af82-c47ba9bd5c03 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:20.718759 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-787498ed-f493-4445-bf42-5448ca153941 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a8231119f34ef98b8a85303c5c447e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08c78acd1db446bac4352f66e792085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:20.732889 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-787498ed-f493-4445-bf42-5448ca153941 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] 10.222.0.45 "GET /compute/v2.1/servers/879465e3-1ea1-4193-aa67-f1648076f9c2" status: 200 len: 1314 microversion: 2.1 time: 0.797908 Aug 01 16:41:20.749465 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 132/275] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:19 2022] GET /compute/v2.1/servers/879465e3-1ea1-4193-aa67-f1648076f9c2 => generated 1314 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:41:20.755011 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-2ca1a220-a183-41df-b5e9-37234ba8b747 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:20.755844 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-2ca1a220-a183-41df-b5e9-37234ba8b747 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:20.762534 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-2ca1a220-a183-41df-b5e9-37234ba8b747 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:20.762893 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-2ca1a220-a183-41df-b5e9-37234ba8b747 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:20.763667 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-2ca1a220-a183-41df-b5e9-37234ba8b747 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:20.764118 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-2ca1a220-a183-41df-b5e9-37234ba8b747 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:20.947333 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-7b2a9362-ffcd-4306-af82-c47ba9bd5c03 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0aed0278344119aae6906f4f52b1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b66d46c3e7d42b88f2dbdc01232fb03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:20.956326 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-7b2a9362-ffcd-4306-af82-c47ba9bd5c03 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db" status: 200 len: 1721 microversion: 2.1 time: 0.672861 Aug 01 16:41:20.957491 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 144/276] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:20 2022] GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db => generated 1721 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:21.049213 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-2ca1a220-a183-41df-b5e9-37234ba8b747 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:21.060971 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-2ca1a220-a183-41df-b5e9-37234ba8b747 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:21.062979 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-2ca1a220-a183-41df-b5e9-37234ba8b747 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:21.064915 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-2ca1a220-a183-41df-b5e9-37234ba8b747 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1724 microversion: 2.20 time: 0.313939 Aug 01 16:41:21.065646 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 133/277] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:41:20 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1724 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:41:21.304922 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-aea46ea9-447c-43c0-8503-3fb56dd81aaa tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:21.306171 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-aea46ea9-447c-43c0-8503-3fb56dd81aaa tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: ddf9be16-b3ce-411b-ac14-17dae5f41821] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:21.315651 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-46e93b93-2151-428f-ae0e-1cc6935aeb91 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Action: 'create', calling method: .version_select at 0x7efd5ec6a280>, body: {"keypair": {"name": "tempest-keypair-645209937", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK9Y5YHLVcEpM7xfyFBU1MpqbcR9LSC/9i92K1WTKMK8J9l44RQTPFDl46VeQ+5q8n8q/le4EKU40ZyogBY6hIslstP8lKVgPcBWl9j3qiZbvPwCPKPFEM/c7MIK2Khakg=="}} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:41:21.325141 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-aea46ea9-447c-43c0-8503-3fb56dd81aaa tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:21.327322 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-aea46ea9-447c-43c0-8503-3fb56dd81aaa tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:21.331968 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-aea46ea9-447c-43c0-8503-3fb56dd81aaa tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:21.332474 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-aea46ea9-447c-43c0-8503-3fb56dd81aaa tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:21.352335 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.quota [None req-46e93b93-2151-428f-ae0e-1cc6935aeb91 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Getting quotas for project 2f46e472f8614c5e847ceb225cc9bff1. Resources: {'key_pairs'} {{(pid=118117) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 16:41:21.361354 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.quota [None req-46e93b93-2151-428f-ae0e-1cc6935aeb91 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Getting quotas for user 1ac7d3acf1204a9f98f9ee14c2b46a5e and project 2f46e472f8614c5e847ceb225cc9bff1. Resources: {'key_pairs'} {{(pid=118117) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 16:41:21.417262 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-46e93b93-2151-428f-ae0e-1cc6935aeb91 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.107204 Aug 01 16:41:21.418537 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 134/278] 10.222.0.45 () {60 vars in 1159 bytes} [Mon Aug 1 16:41:21 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:41:21.546572 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-aea46ea9-447c-43c0-8503-3fb56dd81aaa tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:21.559712 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-aea46ea9-447c-43c0-8503-3fb56dd81aaa tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/ddf9be16-b3ce-411b-ac14-17dae5f41821" status: 200 len: 1521 microversion: 2.1 time: 0.258755 Aug 01 16:41:21.560860 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 145/279] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:21 2022] GET /compute/v2.1/servers/ddf9be16-b3ce-411b-ac14-17dae5f41821 => generated 1521 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:21.754895 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-07a5d41b-1b8d-4d7a-b5c0-64a42cb4a8c6 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:21.756478 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-07a5d41b-1b8d-4d7a-b5c0-64a42cb4a8c6 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] [instance: 879465e3-1ea1-4193-aa67-f1648076f9c2] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:21.763270 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-07a5d41b-1b8d-4d7a-b5c0-64a42cb4a8c6 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:21.763715 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-07a5d41b-1b8d-4d7a-b5c0-64a42cb4a8c6 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:21.764555 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-07a5d41b-1b8d-4d7a-b5c0-64a42cb4a8c6 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:21.765302 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-07a5d41b-1b8d-4d7a-b5c0-64a42cb4a8c6 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:21.958613 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-07a5d41b-1b8d-4d7a-b5c0-64a42cb4a8c6 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a8231119f34ef98b8a85303c5c447e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08c78acd1db446bac4352f66e792085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:21.967983 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-07a5d41b-1b8d-4d7a-b5c0-64a42cb4a8c6 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] 10.222.0.45 "GET /compute/v2.1/servers/879465e3-1ea1-4193-aa67-f1648076f9c2" status: 200 len: 1314 microversion: 2.1 time: 0.217699 Aug 01 16:41:21.968568 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 135/280] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:21 2022] GET /compute/v2.1/servers/879465e3-1ea1-4193-aa67-f1648076f9c2 => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:21.979377 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-bb9b00c0-baf2-40f2-890e-bb4802924a52 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:21.980177 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-bb9b00c0-baf2-40f2-890e-bb4802924a52 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: a3f6b512-e3cb-4e87-8d82-c64f6f1640db] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:21.987453 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-bb9b00c0-baf2-40f2-890e-bb4802924a52 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:21.988109 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-bb9b00c0-baf2-40f2-890e-bb4802924a52 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:21.989032 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-bb9b00c0-baf2-40f2-890e-bb4802924a52 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:21.989592 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-bb9b00c0-baf2-40f2-890e-bb4802924a52 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:22.090336 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-cbf61529-f2e0-4314-880d-e739758fe26a tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:22.091552 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-cbf61529-f2e0-4314-880d-e739758fe26a tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:22.098836 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-cbf61529-f2e0-4314-880d-e739758fe26a tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:22.099872 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-cbf61529-f2e0-4314-880d-e739758fe26a tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:22.100869 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-cbf61529-f2e0-4314-880d-e739758fe26a tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:22.101437 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-cbf61529-f2e0-4314-880d-e739758fe26a tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:22.289103 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-bb9b00c0-baf2-40f2-890e-bb4802924a52 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0aed0278344119aae6906f4f52b1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b66d46c3e7d42b88f2dbdc01232fb03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:22.297471 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-bb9b00c0-baf2-40f2-890e-bb4802924a52 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db" status: 200 len: 1721 microversion: 2.1 time: 0.323318 Aug 01 16:41:22.298703 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 146/281] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:21 2022] GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db => generated 1721 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:22.364494 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-cbf61529-f2e0-4314-880d-e739758fe26a tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:22.373943 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-cbf61529-f2e0-4314-880d-e739758fe26a tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:22.375513 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-cbf61529-f2e0-4314-880d-e739758fe26a tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:22.377065 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-cbf61529-f2e0-4314-880d-e739758fe26a tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1724 microversion: 2.20 time: 0.291673 Aug 01 16:41:22.377858 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 136/282] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:41:22 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1724 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:41:22.583449 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-67892afe-a5dd-4036-a693-16c31633904d tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:22.584123 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-67892afe-a5dd-4036-a693-16c31633904d tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: ddf9be16-b3ce-411b-ac14-17dae5f41821] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:22.590981 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-67892afe-a5dd-4036-a693-16c31633904d tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:22.591795 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-67892afe-a5dd-4036-a693-16c31633904d tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:22.592699 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-67892afe-a5dd-4036-a693-16c31633904d tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:22.593194 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-67892afe-a5dd-4036-a693-16c31633904d tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:22.913965 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-67892afe-a5dd-4036-a693-16c31633904d tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:22.925427 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-67892afe-a5dd-4036-a693-16c31633904d tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/ddf9be16-b3ce-411b-ac14-17dae5f41821" status: 200 len: 1521 microversion: 2.1 time: 0.346482 Aug 01 16:41:22.929713 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 147/283] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:22 2022] GET /compute/v2.1/servers/ddf9be16-b3ce-411b-ac14-17dae5f41821 => generated 1521 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:22.990445 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-13e15d99-2540-4af5-ba26-c323d30237bf tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:22.991069 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-13e15d99-2540-4af5-ba26-c323d30237bf tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] [instance: 879465e3-1ea1-4193-aa67-f1648076f9c2] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:22.999666 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-13e15d99-2540-4af5-ba26-c323d30237bf tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:23.000169 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-13e15d99-2540-4af5-ba26-c323d30237bf tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:23.001052 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-13e15d99-2540-4af5-ba26-c323d30237bf tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:23.001810 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-13e15d99-2540-4af5-ba26-c323d30237bf tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:23.036635 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:41:23.252461 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-13e15d99-2540-4af5-ba26-c323d30237bf tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a8231119f34ef98b8a85303c5c447e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08c78acd1db446bac4352f66e792085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:23.261889 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-13e15d99-2540-4af5-ba26-c323d30237bf tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] 10.222.0.45 "GET /compute/v2.1/servers/879465e3-1ea1-4193-aa67-f1648076f9c2" status: 200 len: 1314 microversion: 2.1 time: 0.275850 Aug 01 16:41:23.263076 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 137/284] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:22 2022] GET /compute/v2.1/servers/879465e3-1ea1-4193-aa67-f1648076f9c2 => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:23.325009 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-6234826a-5f88-46f6-8bf9-07baa121c129 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:23.325606 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-6234826a-5f88-46f6-8bf9-07baa121c129 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: a3f6b512-e3cb-4e87-8d82-c64f6f1640db] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:23.332376 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-6234826a-5f88-46f6-8bf9-07baa121c129 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:23.333119 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-6234826a-5f88-46f6-8bf9-07baa121c129 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:23.334113 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-6234826a-5f88-46f6-8bf9-07baa121c129 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:23.334740 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-6234826a-5f88-46f6-8bf9-07baa121c129 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:23.405146 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-0965cf90-10b9-420d-8d41-9d0760547c9a tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:23.406298 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-0965cf90-10b9-420d-8d41-9d0760547c9a tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:23.416203 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-0965cf90-10b9-420d-8d41-9d0760547c9a tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:23.416685 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-0965cf90-10b9-420d-8d41-9d0760547c9a tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:23.417887 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-0965cf90-10b9-420d-8d41-9d0760547c9a tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:23.418321 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-0965cf90-10b9-420d-8d41-9d0760547c9a tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:23.642265 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-6234826a-5f88-46f6-8bf9-07baa121c129 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0aed0278344119aae6906f4f52b1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b66d46c3e7d42b88f2dbdc01232fb03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:23.650997 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-6234826a-5f88-46f6-8bf9-07baa121c129 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db" status: 200 len: 1721 microversion: 2.1 time: 0.329909 Aug 01 16:41:23.651687 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 148/285] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:23 2022] GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db => generated 1721 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:23.661180 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-d3bb1b88-adc9-463c-8f74-e71a76707080 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-972906879", "imageRef": "c9cb5329-85cb-4472-935d-c4ea1d1f0592", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "94e169bb-9307-4057-852a-5a9a3345875b"}], "security_groups": [{"name": "tempest-securitygroup--1735577083"}], "key_name": "tempest-keypair-645209937", "user_data": "}} {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:41:23.680192 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-0965cf90-10b9-420d-8d41-9d0760547c9a tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:23.691191 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-0965cf90-10b9-420d-8d41-9d0760547c9a tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:23.692912 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-0965cf90-10b9-420d-8d41-9d0760547c9a tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:23.694106 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-0965cf90-10b9-420d-8d41-9d0760547c9a tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1724 microversion: 2.20 time: 0.296977 Aug 01 16:41:23.694836 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 138/286] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:41:23 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1724 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:41:23.787258 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.network.neutron [None req-d3bb1b88-adc9-463c-8f74-e71a76707080 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] validate_networks() for [('94e169bb-9307-4057-852a-5a9a3345875b', None, None, None, None, None)] {{(pid=118118) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 16:41:23.956122 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-8b81a39a-9ac3-4e0a-bcec-64ae646867e8 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:23.956917 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-8b81a39a-9ac3-4e0a-bcec-64ae646867e8 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: ddf9be16-b3ce-411b-ac14-17dae5f41821] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:23.959119 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:41:23.966621 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-8b81a39a-9ac3-4e0a-bcec-64ae646867e8 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:23.967067 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-8b81a39a-9ac3-4e0a-bcec-64ae646867e8 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:23.967983 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-8b81a39a-9ac3-4e0a-bcec-64ae646867e8 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:23.968426 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-8b81a39a-9ac3-4e0a-bcec-64ae646867e8 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:24.213473 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-8b81a39a-9ac3-4e0a-bcec-64ae646867e8 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:24.238006 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-8b81a39a-9ac3-4e0a-bcec-64ae646867e8 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/ddf9be16-b3ce-411b-ac14-17dae5f41821" status: 200 len: 1521 microversion: 2.1 time: 0.286718 Aug 01 16:41:24.239003 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 139/287] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:23 2022] GET /compute/v2.1/servers/ddf9be16-b3ce-411b-ac14-17dae5f41821 => generated 1521 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:24.284059 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-44af2488-600e-48fc-991a-8cbfbbfd93b3 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:24.285694 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-44af2488-600e-48fc-991a-8cbfbbfd93b3 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] [instance: 879465e3-1ea1-4193-aa67-f1648076f9c2] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:24.288523 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.virt.hardware [None req-d3bb1b88-adc9-463c-8f74-e71a76707080 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Flavor limits 0:0:0 {{(pid=118118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 16:41:24.288950 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.virt.hardware [None req-d3bb1b88-adc9-463c-8f74-e71a76707080 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Image limits 0:0:0 {{(pid=118118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 16:41:24.289435 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.virt.hardware [None req-d3bb1b88-adc9-463c-8f74-e71a76707080 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Flavor pref 0:0:0 {{(pid=118118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 16:41:24.291458 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.virt.hardware [None req-d3bb1b88-adc9-463c-8f74-e71a76707080 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Image pref 0:0:0 {{(pid=118118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 16:41:24.291911 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.virt.hardware [None req-d3bb1b88-adc9-463c-8f74-e71a76707080 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 16:41:24.293515 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-44af2488-600e-48fc-991a-8cbfbbfd93b3 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:24.293962 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-44af2488-600e-48fc-991a-8cbfbbfd93b3 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:24.294721 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-44af2488-600e-48fc-991a-8cbfbbfd93b3 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:24.295290 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-44af2488-600e-48fc-991a-8cbfbbfd93b3 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:24.312505 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-d3bb1b88-adc9-463c-8f74-e71a76707080 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:24.313000 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-d3bb1b88-adc9-463c-8f74-e71a76707080 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:24.313844 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-d3bb1b88-adc9-463c-8f74-e71a76707080 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:24.316726 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-d3bb1b88-adc9-463c-8f74-e71a76707080 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:24.343163 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.quota [None req-d3bb1b88-adc9-463c-8f74-e71a76707080 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Getting quotas for project 2f46e472f8614c5e847ceb225cc9bff1. Resources: {'cores', 'ram', 'instances'} {{(pid=118118) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 16:41:24.348173 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.quota [None req-d3bb1b88-adc9-463c-8f74-e71a76707080 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Getting quotas for user 1ac7d3acf1204a9f98f9ee14c2b46a5e and project 2f46e472f8614c5e847ceb225cc9bff1. Resources: {'cores', 'ram', 'instances'} {{(pid=118118) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 16:41:24.361405 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-d3bb1b88-adc9-463c-8f74-e71a76707080 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Going to run 1 instances... {{(pid=118118) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 16:41:24.363830 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-d3bb1b88-adc9-463c-8f74-e71a76707080 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 53e1f340-623b-4453-8735-db4701fef4ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c9cb5329-85cb-4472-935d-c4ea1d1f0592',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118118) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 16:41:24.417890 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-d3bb1b88-adc9-463c-8f74-e71a76707080 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.764996 Aug 01 16:41:24.418673 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 149/288] 10.222.0.45 () {60 vars in 1147 bytes} [Mon Aug 1 16:41:23 2022] POST /compute/v2.1/servers => generated 402 bytes in 766 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 16:41:24.430598 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-a08236ba-ad54-4448-a60b-a17ae49da0e4 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:24.431610 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-a08236ba-ad54-4448-a60b-a17ae49da0e4 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 53e1f340-623b-4453-8735-db4701fef4ad] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:24.440403 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-44af2488-600e-48fc-991a-8cbfbbfd93b3 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a8231119f34ef98b8a85303c5c447e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08c78acd1db446bac4352f66e792085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:24.449313 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-44af2488-600e-48fc-991a-8cbfbbfd93b3 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] 10.222.0.45 "GET /compute/v2.1/servers/879465e3-1ea1-4193-aa67-f1648076f9c2" status: 200 len: 1314 microversion: 2.1 time: 0.169415 Aug 01 16:41:24.450107 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 140/289] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:24 2022] GET /compute/v2.1/servers/879465e3-1ea1-4193-aa67-f1648076f9c2 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:41:24.493741 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-a08236ba-ad54-4448-a60b-a17ae49da0e4 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac7d3acf1204a9f98f9ee14c2b46a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f46e472f8614c5e847ceb225cc9bff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:24.500895 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-a08236ba-ad54-4448-a60b-a17ae49da0e4 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/53e1f340-623b-4453-8735-db4701fef4ad" status: 200 len: 1240 microversion: 2.1 time: 0.074451 Aug 01 16:41:24.501815 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 150/290] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:24 2022] GET /compute/v2.1/servers/53e1f340-623b-4453-8735-db4701fef4ad => generated 1240 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:24.672948 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-689bdbaf-5305-4d59-9925-7309453dfb1f tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:24.673553 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-689bdbaf-5305-4d59-9925-7309453dfb1f tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: a3f6b512-e3cb-4e87-8d82-c64f6f1640db] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:24.680138 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-689bdbaf-5305-4d59-9925-7309453dfb1f tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:24.680576 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-689bdbaf-5305-4d59-9925-7309453dfb1f tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:24.681338 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-689bdbaf-5305-4d59-9925-7309453dfb1f tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:24.681971 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-689bdbaf-5305-4d59-9925-7309453dfb1f tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:24.718385 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-064dc4de-ebdc-40ad-bdae-efcb5b0b0bde tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:24.719194 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-064dc4de-ebdc-40ad-bdae-efcb5b0b0bde tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:24.727438 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-064dc4de-ebdc-40ad-bdae-efcb5b0b0bde tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:24.728087 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-064dc4de-ebdc-40ad-bdae-efcb5b0b0bde tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:24.729481 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-064dc4de-ebdc-40ad-bdae-efcb5b0b0bde tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:24.730156 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-064dc4de-ebdc-40ad-bdae-efcb5b0b0bde tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:24.873667 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-689bdbaf-5305-4d59-9925-7309453dfb1f tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0aed0278344119aae6906f4f52b1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b66d46c3e7d42b88f2dbdc01232fb03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:24.882362 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-689bdbaf-5305-4d59-9925-7309453dfb1f tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db" status: 200 len: 1721 microversion: 2.1 time: 0.213470 Aug 01 16:41:24.883143 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 141/291] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:24 2022] GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db => generated 1721 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:24.904961 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-064dc4de-ebdc-40ad-bdae-efcb5b0b0bde tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:24.914553 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-064dc4de-ebdc-40ad-bdae-efcb5b0b0bde tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:24.916169 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-064dc4de-ebdc-40ad-bdae-efcb5b0b0bde tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:24.917370 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-064dc4de-ebdc-40ad-bdae-efcb5b0b0bde tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1724 microversion: 2.20 time: 0.202828 Aug 01 16:41:24.917922 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 151/292] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:41:24 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1724 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 16:41:25.259415 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-f9e9ff20-cbf5-4a28-b8de-65c63bbfc9d7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:25.260041 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-f9e9ff20-cbf5-4a28-b8de-65c63bbfc9d7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: ddf9be16-b3ce-411b-ac14-17dae5f41821] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:25.266961 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-f9e9ff20-cbf5-4a28-b8de-65c63bbfc9d7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:25.267408 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-f9e9ff20-cbf5-4a28-b8de-65c63bbfc9d7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:25.268511 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-f9e9ff20-cbf5-4a28-b8de-65c63bbfc9d7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:25.268927 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-f9e9ff20-cbf5-4a28-b8de-65c63bbfc9d7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:25.415951 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-f9e9ff20-cbf5-4a28-b8de-65c63bbfc9d7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:25.426378 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-f9e9ff20-cbf5-4a28-b8de-65c63bbfc9d7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/ddf9be16-b3ce-411b-ac14-17dae5f41821" status: 200 len: 1521 microversion: 2.1 time: 0.170702 Aug 01 16:41:25.427124 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 142/293] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:25 2022] GET /compute/v2.1/servers/ddf9be16-b3ce-411b-ac14-17dae5f41821 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:25.471204 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-21fa7e29-00ef-415f-bd73-5e0a3a8d982a tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:25.471817 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-21fa7e29-00ef-415f-bd73-5e0a3a8d982a tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] [instance: 879465e3-1ea1-4193-aa67-f1648076f9c2] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:25.479139 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-21fa7e29-00ef-415f-bd73-5e0a3a8d982a tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:25.479575 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-21fa7e29-00ef-415f-bd73-5e0a3a8d982a tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:25.480387 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-21fa7e29-00ef-415f-bd73-5e0a3a8d982a tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:25.480817 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-21fa7e29-00ef-415f-bd73-5e0a3a8d982a tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:25.522363 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-2ade365a-b5b7-415b-bf9e-6f2ff6c3728e tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:25.523014 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-2ade365a-b5b7-415b-bf9e-6f2ff6c3728e tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 53e1f340-623b-4453-8735-db4701fef4ad] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:25.529837 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-2ade365a-b5b7-415b-bf9e-6f2ff6c3728e tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:25.530289 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-2ade365a-b5b7-415b-bf9e-6f2ff6c3728e tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:25.531070 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-2ade365a-b5b7-415b-bf9e-6f2ff6c3728e tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:25.531492 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-2ade365a-b5b7-415b-bf9e-6f2ff6c3728e tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:25.603332 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-2ade365a-b5b7-415b-bf9e-6f2ff6c3728e tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac7d3acf1204a9f98f9ee14c2b46a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f46e472f8614c5e847ceb225cc9bff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:25.612080 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-2ade365a-b5b7-415b-bf9e-6f2ff6c3728e tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/53e1f340-623b-4453-8735-db4701fef4ad" status: 200 len: 1244 microversion: 2.1 time: 0.093524 Aug 01 16:41:25.612701 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 143/294] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:25 2022] GET /compute/v2.1/servers/53e1f340-623b-4453-8735-db4701fef4ad => generated 1244 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:25.644813 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-21fa7e29-00ef-415f-bd73-5e0a3a8d982a tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a8231119f34ef98b8a85303c5c447e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08c78acd1db446bac4352f66e792085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:25.654408 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-21fa7e29-00ef-415f-bd73-5e0a3a8d982a tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] 10.222.0.45 "GET /compute/v2.1/servers/879465e3-1ea1-4193-aa67-f1648076f9c2" status: 200 len: 1314 microversion: 2.1 time: 0.187449 Aug 01 16:41:25.654989 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 152/295] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:25 2022] GET /compute/v2.1/servers/879465e3-1ea1-4193-aa67-f1648076f9c2 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:25.904498 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-96bd3f53-bea5-436b-bbbe-898c80db62a9 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:25.905012 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-96bd3f53-bea5-436b-bbbe-898c80db62a9 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: a3f6b512-e3cb-4e87-8d82-c64f6f1640db] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:25.912373 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-96bd3f53-bea5-436b-bbbe-898c80db62a9 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:25.912817 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-96bd3f53-bea5-436b-bbbe-898c80db62a9 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:25.913590 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-96bd3f53-bea5-436b-bbbe-898c80db62a9 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:25.914019 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-96bd3f53-bea5-436b-bbbe-898c80db62a9 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:25.945659 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-35b1a471-dbe3-41ea-9dc7-6fb637fc9c6f tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:25.946348 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-35b1a471-dbe3-41ea-9dc7-6fb637fc9c6f tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:25.953456 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-35b1a471-dbe3-41ea-9dc7-6fb637fc9c6f tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:25.953980 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-35b1a471-dbe3-41ea-9dc7-6fb637fc9c6f tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:25.954814 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-35b1a471-dbe3-41ea-9dc7-6fb637fc9c6f tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:25.955311 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-35b1a471-dbe3-41ea-9dc7-6fb637fc9c6f tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:26.102875 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-96bd3f53-bea5-436b-bbbe-898c80db62a9 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0aed0278344119aae6906f4f52b1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b66d46c3e7d42b88f2dbdc01232fb03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:26.111605 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-96bd3f53-bea5-436b-bbbe-898c80db62a9 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db" status: 200 len: 1721 microversion: 2.1 time: 0.211047 Aug 01 16:41:26.112257 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 144/296] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:25 2022] GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db => generated 1721 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:26.132320 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-35b1a471-dbe3-41ea-9dc7-6fb637fc9c6f tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:26.140550 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-35b1a471-dbe3-41ea-9dc7-6fb637fc9c6f tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:26.142147 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-35b1a471-dbe3-41ea-9dc7-6fb637fc9c6f tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:26.143303 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-35b1a471-dbe3-41ea-9dc7-6fb637fc9c6f tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1724 microversion: 2.20 time: 0.201767 Aug 01 16:41:26.143882 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 153/297] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:41:25 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1724 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:41:26.448649 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-17ce8794-bd5f-4f04-b126-c45f1cdecef0 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:26.449268 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-17ce8794-bd5f-4f04-b126-c45f1cdecef0 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: ddf9be16-b3ce-411b-ac14-17dae5f41821] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:26.456425 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-17ce8794-bd5f-4f04-b126-c45f1cdecef0 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:26.456878 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-17ce8794-bd5f-4f04-b126-c45f1cdecef0 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:26.457675 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-17ce8794-bd5f-4f04-b126-c45f1cdecef0 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:26.458107 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-17ce8794-bd5f-4f04-b126-c45f1cdecef0 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:26.606883 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-17ce8794-bd5f-4f04-b126-c45f1cdecef0 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:26.615081 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-17ce8794-bd5f-4f04-b126-c45f1cdecef0 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/ddf9be16-b3ce-411b-ac14-17dae5f41821" status: 200 len: 1521 microversion: 2.1 time: 0.170301 Aug 01 16:41:26.615666 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 145/298] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:26 2022] GET /compute/v2.1/servers/ddf9be16-b3ce-411b-ac14-17dae5f41821 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:26.633300 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-54631bc6-905d-4966-8702-0ea6b1cdae16 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:26.633914 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-54631bc6-905d-4966-8702-0ea6b1cdae16 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 53e1f340-623b-4453-8735-db4701fef4ad] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:26.640485 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-54631bc6-905d-4966-8702-0ea6b1cdae16 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:26.640951 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-54631bc6-905d-4966-8702-0ea6b1cdae16 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:26.642142 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-54631bc6-905d-4966-8702-0ea6b1cdae16 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:26.642503 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-54631bc6-905d-4966-8702-0ea6b1cdae16 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:26.677542 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-b663970a-39bd-4189-8ff0-fa7ea6878557 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:26.678258 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-b663970a-39bd-4189-8ff0-fa7ea6878557 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] [instance: 879465e3-1ea1-4193-aa67-f1648076f9c2] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:26.685607 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-b663970a-39bd-4189-8ff0-fa7ea6878557 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:26.686025 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-b663970a-39bd-4189-8ff0-fa7ea6878557 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:26.686817 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-b663970a-39bd-4189-8ff0-fa7ea6878557 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:26.687237 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-b663970a-39bd-4189-8ff0-fa7ea6878557 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:26.706266 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-54631bc6-905d-4966-8702-0ea6b1cdae16 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac7d3acf1204a9f98f9ee14c2b46a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f46e472f8614c5e847ceb225cc9bff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:26.713708 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-54631bc6-905d-4966-8702-0ea6b1cdae16 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/53e1f340-623b-4453-8735-db4701fef4ad" status: 200 len: 1244 microversion: 2.1 time: 0.084364 Aug 01 16:41:26.714283 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 154/299] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:26 2022] GET /compute/v2.1/servers/53e1f340-623b-4453-8735-db4701fef4ad => generated 1244 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:26.820326 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-b663970a-39bd-4189-8ff0-fa7ea6878557 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a8231119f34ef98b8a85303c5c447e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08c78acd1db446bac4352f66e792085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:26.827829 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-b663970a-39bd-4189-8ff0-fa7ea6878557 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] 10.222.0.45 "GET /compute/v2.1/servers/879465e3-1ea1-4193-aa67-f1648076f9c2" status: 200 len: 1314 microversion: 2.1 time: 0.154345 Aug 01 16:41:26.829326 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 146/300] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:26 2022] GET /compute/v2.1/servers/879465e3-1ea1-4193-aa67-f1648076f9c2 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:27.133206 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-04bba5c9-d77c-447d-8eaf-fcc78872e251 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:27.133785 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-04bba5c9-d77c-447d-8eaf-fcc78872e251 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: a3f6b512-e3cb-4e87-8d82-c64f6f1640db] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:27.140576 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-04bba5c9-d77c-447d-8eaf-fcc78872e251 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:27.141218 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-04bba5c9-d77c-447d-8eaf-fcc78872e251 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:27.142348 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-04bba5c9-d77c-447d-8eaf-fcc78872e251 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:27.142778 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-04bba5c9-d77c-447d-8eaf-fcc78872e251 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:27.166513 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-7c45a57b-d9e6-4fa3-853c-b63209968b47 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:27.167253 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-7c45a57b-d9e6-4fa3-853c-b63209968b47 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:27.169177 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_cell0:SELECT=4 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:41:27.175421 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-7c45a57b-d9e6-4fa3-853c-b63209968b47 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:27.175916 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-7c45a57b-d9e6-4fa3-853c-b63209968b47 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:27.176689 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-7c45a57b-d9e6-4fa3-853c-b63209968b47 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:27.177322 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-7c45a57b-d9e6-4fa3-853c-b63209968b47 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:27.346199 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-04bba5c9-d77c-447d-8eaf-fcc78872e251 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0aed0278344119aae6906f4f52b1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b66d46c3e7d42b88f2dbdc01232fb03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:27.360152 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-04bba5c9-d77c-447d-8eaf-fcc78872e251 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db" status: 200 len: 1721 microversion: 2.1 time: 0.230474 Aug 01 16:41:27.361110 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 155/301] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:27 2022] GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db => generated 1721 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:27.418003 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-7c45a57b-d9e6-4fa3-853c-b63209968b47 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:27.439986 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-7c45a57b-d9e6-4fa3-853c-b63209968b47 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:27.441953 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-7c45a57b-d9e6-4fa3-853c-b63209968b47 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:27.443979 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-7c45a57b-d9e6-4fa3-853c-b63209968b47 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1724 microversion: 2.20 time: 0.281362 Aug 01 16:41:27.460153 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 147/302] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:41:27 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1724 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:41:27.552919 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [req-d72bf128-5e72-42e6-8f7c-b092178b0672 req-4a805a46-4219-4228-be78-34a396e8ee91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "879465e3-1ea1-4193-aa67-f1648076f9c2", "name": "network-vif-plugged", "status": "completed", "tag": "90beeb8e-5d34-4a76-bb5b-966b9ac81523"}]} {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:41:27.564232 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-d72bf128-5e72-42e6-8f7c-b092178b0672 req-4a805a46-4219-4228-be78-34a396e8ee91 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:27.564781 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-d72bf128-5e72-42e6-8f7c-b092178b0672 req-4a805a46-4219-4228-be78-34a396e8ee91 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:27.578196 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.compute.server_external_events [req-d72bf128-5e72-42e6-8f7c-b092178b0672 req-4a805a46-4219-4228-be78-34a396e8ee91 service nova] Creating event network-vif-plugged:90beeb8e-5d34-4a76-bb5b-966b9ac81523 for instance 879465e3-1ea1-4193-aa67-f1648076f9c2 on hv-cinder-85032 Aug 01 16:41:27.584231 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [req-d72bf128-5e72-42e6-8f7c-b092178b0672 req-4a805a46-4219-4228-be78-34a396e8ee91 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035235 Aug 01 16:41:27.584873 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 156/303] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:41:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:41:27.636058 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-9075727e-b84c-4f3a-adee-a0bad80d10e3 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:27.636674 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-9075727e-b84c-4f3a-adee-a0bad80d10e3 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: ddf9be16-b3ce-411b-ac14-17dae5f41821] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:27.644208 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-9075727e-b84c-4f3a-adee-a0bad80d10e3 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:27.644590 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-9075727e-b84c-4f3a-adee-a0bad80d10e3 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:27.645362 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-9075727e-b84c-4f3a-adee-a0bad80d10e3 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:27.645792 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-9075727e-b84c-4f3a-adee-a0bad80d10e3 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:27.737358 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-fe3389ed-24d6-42ef-bd1a-5678196765c4 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:27.737984 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-fe3389ed-24d6-42ef-bd1a-5678196765c4 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 53e1f340-623b-4453-8735-db4701fef4ad] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:27.744880 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-fe3389ed-24d6-42ef-bd1a-5678196765c4 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:27.745325 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-fe3389ed-24d6-42ef-bd1a-5678196765c4 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:27.746130 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-fe3389ed-24d6-42ef-bd1a-5678196765c4 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:27.746544 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-fe3389ed-24d6-42ef-bd1a-5678196765c4 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:27.802984 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-9075727e-b84c-4f3a-adee-a0bad80d10e3 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:27.811051 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-9075727e-b84c-4f3a-adee-a0bad80d10e3 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/ddf9be16-b3ce-411b-ac14-17dae5f41821" status: 200 len: 1521 microversion: 2.1 time: 0.178854 Aug 01 16:41:27.811903 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 148/304] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:27 2022] GET /compute/v2.1/servers/ddf9be16-b3ce-411b-ac14-17dae5f41821 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:27.820444 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-fe3389ed-24d6-42ef-bd1a-5678196765c4 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac7d3acf1204a9f98f9ee14c2b46a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f46e472f8614c5e847ceb225cc9bff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:27.828540 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-fe3389ed-24d6-42ef-bd1a-5678196765c4 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/53e1f340-623b-4453-8735-db4701fef4ad" status: 200 len: 1236 microversion: 2.1 time: 0.096339 Aug 01 16:41:27.829223 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 157/305] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:27 2022] GET /compute/v2.1/servers/53e1f340-623b-4453-8735-db4701fef4ad => generated 1236 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:27.849310 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-9adbbd06-bed1-4347-b9c1-ae20d73e252b tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:27.849928 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-9adbbd06-bed1-4347-b9c1-ae20d73e252b tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] [instance: 879465e3-1ea1-4193-aa67-f1648076f9c2] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:27.856472 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-9adbbd06-bed1-4347-b9c1-ae20d73e252b tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:27.856921 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-9adbbd06-bed1-4347-b9c1-ae20d73e252b tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:27.857681 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-9adbbd06-bed1-4347-b9c1-ae20d73e252b tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:27.858113 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-9adbbd06-bed1-4347-b9c1-ae20d73e252b tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:28.006514 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-9adbbd06-bed1-4347-b9c1-ae20d73e252b tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a8231119f34ef98b8a85303c5c447e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08c78acd1db446bac4352f66e792085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:28.015821 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-9adbbd06-bed1-4347-b9c1-ae20d73e252b tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] 10.222.0.45 "GET /compute/v2.1/servers/879465e3-1ea1-4193-aa67-f1648076f9c2" status: 200 len: 1314 microversion: 2.1 time: 0.170604 Aug 01 16:41:28.016907 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 149/306] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:27 2022] GET /compute/v2.1/servers/879465e3-1ea1-4193-aa67-f1648076f9c2 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:28.397312 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-e451d830-5538-4b6a-b656-cb9dddf6701b tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:28.397928 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-e451d830-5538-4b6a-b656-cb9dddf6701b tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: a3f6b512-e3cb-4e87-8d82-c64f6f1640db] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:28.404428 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-e451d830-5538-4b6a-b656-cb9dddf6701b tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:28.404869 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-e451d830-5538-4b6a-b656-cb9dddf6701b tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:28.405667 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-e451d830-5538-4b6a-b656-cb9dddf6701b tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:28.406090 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-e451d830-5538-4b6a-b656-cb9dddf6701b tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:28.468313 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-4f48ca2b-82f2-49e6-b213-195a500d8cfa tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:28.468313 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-4f48ca2b-82f2-49e6-b213-195a500d8cfa tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:28.475114 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-4f48ca2b-82f2-49e6-b213-195a500d8cfa tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:28.475809 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-4f48ca2b-82f2-49e6-b213-195a500d8cfa tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:28.476464 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-4f48ca2b-82f2-49e6-b213-195a500d8cfa tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:28.476894 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-4f48ca2b-82f2-49e6-b213-195a500d8cfa tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:28.650238 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-e451d830-5538-4b6a-b656-cb9dddf6701b tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0aed0278344119aae6906f4f52b1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b66d46c3e7d42b88f2dbdc01232fb03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:28.660744 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-e451d830-5538-4b6a-b656-cb9dddf6701b tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db" status: 200 len: 1721 microversion: 2.1 time: 0.267375 Aug 01 16:41:28.675831 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 158/307] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:28 2022] GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db => generated 1721 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:28.710184 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-4f48ca2b-82f2-49e6-b213-195a500d8cfa tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:28.718376 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-4f48ca2b-82f2-49e6-b213-195a500d8cfa tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:28.721197 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-4f48ca2b-82f2-49e6-b213-195a500d8cfa tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:28.722228 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-4f48ca2b-82f2-49e6-b213-195a500d8cfa tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1724 microversion: 2.20 time: 0.259524 Aug 01 16:41:28.722792 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 150/308] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:41:28 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1724 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 16:41:28.833612 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-4c7907e8-8f99-43c0-ba7c-2f352625ceb1 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:28.834214 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-4c7907e8-8f99-43c0-ba7c-2f352625ceb1 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: ddf9be16-b3ce-411b-ac14-17dae5f41821] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:28.840876 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-4c7907e8-8f99-43c0-ba7c-2f352625ceb1 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:28.841321 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-4c7907e8-8f99-43c0-ba7c-2f352625ceb1 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:28.842109 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-4c7907e8-8f99-43c0-ba7c-2f352625ceb1 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:28.842511 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-4c7907e8-8f99-43c0-ba7c-2f352625ceb1 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:28.851066 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-24d923a8-fa4e-41cc-8048-16f7241c5378 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:28.851899 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-24d923a8-fa4e-41cc-8048-16f7241c5378 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 53e1f340-623b-4453-8735-db4701fef4ad] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:28.858702 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-24d923a8-fa4e-41cc-8048-16f7241c5378 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:28.859150 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-24d923a8-fa4e-41cc-8048-16f7241c5378 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:28.860208 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-24d923a8-fa4e-41cc-8048-16f7241c5378 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:28.860934 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-24d923a8-fa4e-41cc-8048-16f7241c5378 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:28.943707 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-24d923a8-fa4e-41cc-8048-16f7241c5378 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac7d3acf1204a9f98f9ee14c2b46a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f46e472f8614c5e847ceb225cc9bff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:28.952137 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-24d923a8-fa4e-41cc-8048-16f7241c5378 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/53e1f340-623b-4453-8735-db4701fef4ad" status: 200 len: 1292 microversion: 2.1 time: 0.105495 Aug 01 16:41:28.965728 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 151/309] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:28 2022] GET /compute/v2.1/servers/53e1f340-623b-4453-8735-db4701fef4ad => generated 1292 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:29.013429 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-4c7907e8-8f99-43c0-ba7c-2f352625ceb1 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:29.025341 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-4c7907e8-8f99-43c0-ba7c-2f352625ceb1 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/ddf9be16-b3ce-411b-ac14-17dae5f41821" status: 200 len: 1521 microversion: 2.1 time: 0.195758 Aug 01 16:41:29.026128 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 159/310] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:28 2022] GET /compute/v2.1/servers/ddf9be16-b3ce-411b-ac14-17dae5f41821 => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:29.038424 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-150a4815-02b0-410a-a16e-a60fb215f83b tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:29.039027 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-150a4815-02b0-410a-a16e-a60fb215f83b tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] [instance: 879465e3-1ea1-4193-aa67-f1648076f9c2] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:29.045381 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-150a4815-02b0-410a-a16e-a60fb215f83b tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:29.045834 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-150a4815-02b0-410a-a16e-a60fb215f83b tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:29.046590 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-150a4815-02b0-410a-a16e-a60fb215f83b tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:29.047406 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-150a4815-02b0-410a-a16e-a60fb215f83b tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:29.183802 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-150a4815-02b0-410a-a16e-a60fb215f83b tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a8231119f34ef98b8a85303c5c447e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08c78acd1db446bac4352f66e792085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:29.192717 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-150a4815-02b0-410a-a16e-a60fb215f83b tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] 10.222.0.45 "GET /compute/v2.1/servers/879465e3-1ea1-4193-aa67-f1648076f9c2" status: 200 len: 1314 microversion: 2.1 time: 0.158200 Aug 01 16:41:29.193215 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 152/311] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:29 2022] GET /compute/v2.1/servers/879465e3-1ea1-4193-aa67-f1648076f9c2 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:29.682665 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-66aeb2d4-7ba9-4ccf-a236-5c58f9c1cea8 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:29.683287 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-66aeb2d4-7ba9-4ccf-a236-5c58f9c1cea8 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: a3f6b512-e3cb-4e87-8d82-c64f6f1640db] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:29.690269 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-66aeb2d4-7ba9-4ccf-a236-5c58f9c1cea8 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:29.690712 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-66aeb2d4-7ba9-4ccf-a236-5c58f9c1cea8 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:29.691491 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-66aeb2d4-7ba9-4ccf-a236-5c58f9c1cea8 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:29.691953 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-66aeb2d4-7ba9-4ccf-a236-5c58f9c1cea8 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:29.707905 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_cell1:SELECT=100 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:41:29.746186 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-19e70032-1c06-4a54-8429-3316f8fedeac tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:29.746824 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-19e70032-1c06-4a54-8429-3316f8fedeac tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:29.754273 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-19e70032-1c06-4a54-8429-3316f8fedeac tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:29.754722 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-19e70032-1c06-4a54-8429-3316f8fedeac tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:29.755507 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-19e70032-1c06-4a54-8429-3316f8fedeac tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:29.755971 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-19e70032-1c06-4a54-8429-3316f8fedeac tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:29.872962 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-66aeb2d4-7ba9-4ccf-a236-5c58f9c1cea8 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0aed0278344119aae6906f4f52b1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b66d46c3e7d42b88f2dbdc01232fb03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:29.883167 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-66aeb2d4-7ba9-4ccf-a236-5c58f9c1cea8 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db" status: 200 len: 1721 microversion: 2.1 time: 0.204365 Aug 01 16:41:29.883865 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 160/312] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:29 2022] GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db => generated 1721 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:29.914287 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-19e70032-1c06-4a54-8429-3316f8fedeac tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:29.923368 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-19e70032-1c06-4a54-8429-3316f8fedeac tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:29.924952 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-19e70032-1c06-4a54-8429-3316f8fedeac tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:29.926119 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-19e70032-1c06-4a54-8429-3316f8fedeac tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1724 microversion: 2.20 time: 0.183857 Aug 01 16:41:29.926681 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 153/313] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:41:29 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 16:41:29.974340 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-61602724-c9cc-4fcb-9461-c8036103af27 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:29.975050 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-61602724-c9cc-4fcb-9461-c8036103af27 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 53e1f340-623b-4453-8735-db4701fef4ad] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:29.981806 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-61602724-c9cc-4fcb-9461-c8036103af27 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:29.982251 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-61602724-c9cc-4fcb-9461-c8036103af27 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:29.983014 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-61602724-c9cc-4fcb-9461-c8036103af27 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:29.983441 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-61602724-c9cc-4fcb-9461-c8036103af27 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:30.046719 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-61602724-c9cc-4fcb-9461-c8036103af27 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac7d3acf1204a9f98f9ee14c2b46a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f46e472f8614c5e847ceb225cc9bff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:30.049432 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-d8c6ecee-0ffa-410b-b56e-66afcabf565f tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:30.050048 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-d8c6ecee-0ffa-410b-b56e-66afcabf565f tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: ddf9be16-b3ce-411b-ac14-17dae5f41821] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:30.054561 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-61602724-c9cc-4fcb-9461-c8036103af27 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/53e1f340-623b-4453-8735-db4701fef4ad" status: 200 len: 1292 microversion: 2.1 time: 0.084564 Aug 01 16:41:30.055338 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 161/314] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:29 2022] GET /compute/v2.1/servers/53e1f340-623b-4453-8735-db4701fef4ad => generated 1292 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:30.056530 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-d8c6ecee-0ffa-410b-b56e-66afcabf565f tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:30.056958 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-d8c6ecee-0ffa-410b-b56e-66afcabf565f tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:30.057752 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-d8c6ecee-0ffa-410b-b56e-66afcabf565f tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:30.058199 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-d8c6ecee-0ffa-410b-b56e-66afcabf565f tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:30.060850 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_cell1:SELECT=100 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:41:30.190258 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-d8c6ecee-0ffa-410b-b56e-66afcabf565f tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:30.198263 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-d8c6ecee-0ffa-410b-b56e-66afcabf565f tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/ddf9be16-b3ce-411b-ac14-17dae5f41821" status: 200 len: 1521 microversion: 2.1 time: 0.153054 Aug 01 16:41:30.198832 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 154/315] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:30 2022] GET /compute/v2.1/servers/ddf9be16-b3ce-411b-ac14-17dae5f41821 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:30.213895 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-77f8ae52-f899-4209-ab47-b3dbaf87078c tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:30.214503 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-77f8ae52-f899-4209-ab47-b3dbaf87078c tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] [instance: 879465e3-1ea1-4193-aa67-f1648076f9c2] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:30.220991 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-77f8ae52-f899-4209-ab47-b3dbaf87078c tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:30.221426 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-77f8ae52-f899-4209-ab47-b3dbaf87078c tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:30.222162 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-77f8ae52-f899-4209-ab47-b3dbaf87078c tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:30.222579 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-77f8ae52-f899-4209-ab47-b3dbaf87078c tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:30.354626 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-77f8ae52-f899-4209-ab47-b3dbaf87078c tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a8231119f34ef98b8a85303c5c447e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08c78acd1db446bac4352f66e792085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:30.362399 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-77f8ae52-f899-4209-ab47-b3dbaf87078c tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] 10.222.0.45 "GET /compute/v2.1/servers/879465e3-1ea1-4193-aa67-f1648076f9c2" status: 200 len: 1314 microversion: 2.1 time: 0.152517 Aug 01 16:41:30.362939 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 162/316] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:30 2022] GET /compute/v2.1/servers/879465e3-1ea1-4193-aa67-f1648076f9c2 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:30.905106 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-34cf8174-9b7e-48ac-95ec-2f9a1e01cb29 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:30.905721 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-34cf8174-9b7e-48ac-95ec-2f9a1e01cb29 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: a3f6b512-e3cb-4e87-8d82-c64f6f1640db] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:30.913122 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-34cf8174-9b7e-48ac-95ec-2f9a1e01cb29 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:30.913755 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-34cf8174-9b7e-48ac-95ec-2f9a1e01cb29 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:30.914245 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-34cf8174-9b7e-48ac-95ec-2f9a1e01cb29 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:30.914832 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-34cf8174-9b7e-48ac-95ec-2f9a1e01cb29 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:30.954513 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-1b0944bd-1666-409e-8dd9-90c37988d44c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:30.955363 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-1b0944bd-1666-409e-8dd9-90c37988d44c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:30.957313 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:41:30.963101 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-1b0944bd-1666-409e-8dd9-90c37988d44c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:30.963537 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-1b0944bd-1666-409e-8dd9-90c37988d44c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:30.964333 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-1b0944bd-1666-409e-8dd9-90c37988d44c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:30.964795 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-1b0944bd-1666-409e-8dd9-90c37988d44c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:31.105961 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-34cf8174-9b7e-48ac-95ec-2f9a1e01cb29 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0aed0278344119aae6906f4f52b1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b66d46c3e7d42b88f2dbdc01232fb03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:31.114572 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-34cf8174-9b7e-48ac-95ec-2f9a1e01cb29 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db" status: 200 len: 1721 microversion: 2.1 time: 0.213339 Aug 01 16:41:31.115152 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 155/317] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:30 2022] GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db => generated 1721 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:31.120027 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-b7a2f3f2-71a2-469d-84e3-27fcd8eac64f tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:31.120628 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-b7a2f3f2-71a2-469d-84e3-27fcd8eac64f tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 53e1f340-623b-4453-8735-db4701fef4ad] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:31.127556 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-b7a2f3f2-71a2-469d-84e3-27fcd8eac64f tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:31.128037 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-b7a2f3f2-71a2-469d-84e3-27fcd8eac64f tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:31.128832 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-b7a2f3f2-71a2-469d-84e3-27fcd8eac64f tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:31.129252 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-b7a2f3f2-71a2-469d-84e3-27fcd8eac64f tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:31.141262 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-1b0944bd-1666-409e-8dd9-90c37988d44c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:31.150181 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-1b0944bd-1666-409e-8dd9-90c37988d44c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:31.151691 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-1b0944bd-1666-409e-8dd9-90c37988d44c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:31.152859 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-1b0944bd-1666-409e-8dd9-90c37988d44c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1724 microversion: 2.20 time: 0.202306 Aug 01 16:41:31.153413 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 163/318] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:41:30 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1724 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:41:31.195273 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-b7a2f3f2-71a2-469d-84e3-27fcd8eac64f tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac7d3acf1204a9f98f9ee14c2b46a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f46e472f8614c5e847ceb225cc9bff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:31.208552 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-b7a2f3f2-71a2-469d-84e3-27fcd8eac64f tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/53e1f340-623b-4453-8735-db4701fef4ad" status: 200 len: 1292 microversion: 2.1 time: 0.092336 Aug 01 16:41:31.209118 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 156/319] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:31 2022] GET /compute/v2.1/servers/53e1f340-623b-4453-8735-db4701fef4ad => generated 1292 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:31.218341 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-0b6c1a61-8df7-4dc4-b47d-d37805c9e330 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:31.219066 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-0b6c1a61-8df7-4dc4-b47d-d37805c9e330 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: ddf9be16-b3ce-411b-ac14-17dae5f41821] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:31.226040 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-0b6c1a61-8df7-4dc4-b47d-d37805c9e330 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:31.226487 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-0b6c1a61-8df7-4dc4-b47d-d37805c9e330 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:31.227244 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-0b6c1a61-8df7-4dc4-b47d-d37805c9e330 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:31.227676 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-0b6c1a61-8df7-4dc4-b47d-d37805c9e330 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:31.364404 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-0b6c1a61-8df7-4dc4-b47d-d37805c9e330 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:31.376536 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-0b6c1a61-8df7-4dc4-b47d-d37805c9e330 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/ddf9be16-b3ce-411b-ac14-17dae5f41821" status: 200 len: 1521 microversion: 2.1 time: 0.161271 Aug 01 16:41:31.377411 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 164/320] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:31 2022] GET /compute/v2.1/servers/ddf9be16-b3ce-411b-ac14-17dae5f41821 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:31.385029 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-1c54727e-86b6-4bdf-a05a-f057a37fb97f tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:31.385927 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-1c54727e-86b6-4bdf-a05a-f057a37fb97f tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] [instance: 879465e3-1ea1-4193-aa67-f1648076f9c2] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:31.388599 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_cell0:SELECT=12 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:41:31.394345 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-1c54727e-86b6-4bdf-a05a-f057a37fb97f tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:31.394795 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-1c54727e-86b6-4bdf-a05a-f057a37fb97f tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:31.395836 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-1c54727e-86b6-4bdf-a05a-f057a37fb97f tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:31.396075 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-1c54727e-86b6-4bdf-a05a-f057a37fb97f tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:31.535391 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-1c54727e-86b6-4bdf-a05a-f057a37fb97f tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a8231119f34ef98b8a85303c5c447e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08c78acd1db446bac4352f66e792085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:31.544930 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-1c54727e-86b6-4bdf-a05a-f057a37fb97f tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] 10.222.0.45 "GET /compute/v2.1/servers/879465e3-1ea1-4193-aa67-f1648076f9c2" status: 200 len: 1314 microversion: 2.1 time: 0.165336 Aug 01 16:41:31.545511 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 157/321] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:31 2022] GET /compute/v2.1/servers/879465e3-1ea1-4193-aa67-f1648076f9c2 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:41:32.136851 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-11659757-c1e4-4442-92ea-ca47bbbb2346 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:32.137549 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-11659757-c1e4-4442-92ea-ca47bbbb2346 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: a3f6b512-e3cb-4e87-8d82-c64f6f1640db] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:32.146166 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-11659757-c1e4-4442-92ea-ca47bbbb2346 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:32.146687 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-11659757-c1e4-4442-92ea-ca47bbbb2346 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:32.147507 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-11659757-c1e4-4442-92ea-ca47bbbb2346 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:32.147958 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-11659757-c1e4-4442-92ea-ca47bbbb2346 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:32.181271 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-46392b99-0514-41b3-afd4-9a5a84b9a111 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:32.181965 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-46392b99-0514-41b3-afd4-9a5a84b9a111 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:32.189620 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-46392b99-0514-41b3-afd4-9a5a84b9a111 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:32.190159 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-46392b99-0514-41b3-afd4-9a5a84b9a111 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:32.191037 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-46392b99-0514-41b3-afd4-9a5a84b9a111 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:32.191504 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-46392b99-0514-41b3-afd4-9a5a84b9a111 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:32.338055 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-11659757-c1e4-4442-92ea-ca47bbbb2346 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0aed0278344119aae6906f4f52b1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b66d46c3e7d42b88f2dbdc01232fb03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:32.347028 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-11659757-c1e4-4442-92ea-ca47bbbb2346 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db" status: 200 len: 1721 microversion: 2.1 time: 0.213843 Aug 01 16:41:32.359628 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 165/322] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:32 2022] GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db => generated 1721 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:32.359628 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-73189866-6300-490e-8eb4-6a3322e05440 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:32.359628 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-73189866-6300-490e-8eb4-6a3322e05440 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 53e1f340-623b-4453-8735-db4701fef4ad] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:32.359628 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-73189866-6300-490e-8eb4-6a3322e05440 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:32.360125 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-73189866-6300-490e-8eb4-6a3322e05440 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:32.361067 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-73189866-6300-490e-8eb4-6a3322e05440 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:32.361503 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-73189866-6300-490e-8eb4-6a3322e05440 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:32.370666 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-46392b99-0514-41b3-afd4-9a5a84b9a111 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:32.379072 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-46392b99-0514-41b3-afd4-9a5a84b9a111 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:32.380611 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-46392b99-0514-41b3-afd4-9a5a84b9a111 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:32.381788 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-46392b99-0514-41b3-afd4-9a5a84b9a111 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1724 microversion: 2.20 time: 0.205025 Aug 01 16:41:32.382335 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 158/323] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:41:32 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1724 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 16:41:32.401586 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-327b7b2f-64b6-4d6e-8dcd-45ba0f4b4878 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:32.402195 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-327b7b2f-64b6-4d6e-8dcd-45ba0f4b4878 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: ddf9be16-b3ce-411b-ac14-17dae5f41821] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:32.409124 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-327b7b2f-64b6-4d6e-8dcd-45ba0f4b4878 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:32.409590 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-327b7b2f-64b6-4d6e-8dcd-45ba0f4b4878 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:32.410367 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-327b7b2f-64b6-4d6e-8dcd-45ba0f4b4878 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:32.410795 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-327b7b2f-64b6-4d6e-8dcd-45ba0f4b4878 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:32.424825 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-73189866-6300-490e-8eb4-6a3322e05440 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac7d3acf1204a9f98f9ee14c2b46a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f46e472f8614c5e847ceb225cc9bff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:32.433004 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-73189866-6300-490e-8eb4-6a3322e05440 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/53e1f340-623b-4453-8735-db4701fef4ad" status: 200 len: 1300 microversion: 2.1 time: 0.084505 Aug 01 16:41:32.433685 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 166/324] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:32 2022] GET /compute/v2.1/servers/53e1f340-623b-4453-8735-db4701fef4ad => generated 1300 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:32.545552 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-327b7b2f-64b6-4d6e-8dcd-45ba0f4b4878 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:32.553200 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-327b7b2f-64b6-4d6e-8dcd-45ba0f4b4878 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/ddf9be16-b3ce-411b-ac14-17dae5f41821" status: 200 len: 1521 microversion: 2.1 time: 0.155380 Aug 01 16:41:32.553754 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 159/325] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:32 2022] GET /compute/v2.1/servers/ddf9be16-b3ce-411b-ac14-17dae5f41821 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:41:32.566817 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-8719012d-1019-45c3-b2b6-0120549c6363 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:32.567424 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-8719012d-1019-45c3-b2b6-0120549c6363 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] [instance: 879465e3-1ea1-4193-aa67-f1648076f9c2] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:32.573758 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-8719012d-1019-45c3-b2b6-0120549c6363 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:32.574207 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-8719012d-1019-45c3-b2b6-0120549c6363 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:32.574961 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-8719012d-1019-45c3-b2b6-0120549c6363 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:32.575384 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-8719012d-1019-45c3-b2b6-0120549c6363 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:32.715365 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-8719012d-1019-45c3-b2b6-0120549c6363 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a8231119f34ef98b8a85303c5c447e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08c78acd1db446bac4352f66e792085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:32.724062 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-8719012d-1019-45c3-b2b6-0120549c6363 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] 10.222.0.45 "GET /compute/v2.1/servers/879465e3-1ea1-4193-aa67-f1648076f9c2" status: 200 len: 1314 microversion: 2.1 time: 0.161041 Aug 01 16:41:32.724995 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 167/326] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:32 2022] GET /compute/v2.1/servers/879465e3-1ea1-4193-aa67-f1648076f9c2 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:32.959198 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-ee4842f4-7b8b-4fc0-9ca3-1b8814b1af95 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:32.960455 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-ee4842f4-7b8b-4fc0-9ca3-1b8814b1af95 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] [instance: 348b2621-1bf9-431b-b639-9aabbf68a3cf] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:32.992002 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-ee4842f4-7b8b-4fc0-9ca3-1b8814b1af95 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:32.992427 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-ee4842f4-7b8b-4fc0-9ca3-1b8814b1af95 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:32.993372 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-ee4842f4-7b8b-4fc0-9ca3-1b8814b1af95 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:32.994023 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-ee4842f4-7b8b-4fc0-9ca3-1b8814b1af95 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:33.138891 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-ee4842f4-7b8b-4fc0-9ca3-1b8814b1af95 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a95d9f48c64b0fbb8879d361bc177d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019734069da44b2d88561549bd07544d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:33.150336 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-ee4842f4-7b8b-4fc0-9ca3-1b8814b1af95 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] 10.222.0.45 "GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf" status: 200 len: 1594 microversion: 2.1 time: 0.194921 Aug 01 16:41:33.151789 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 160/327] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:32 2022] GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf => generated 1594 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:33.369627 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-dcd1bc29-eda9-4e20-945b-8b272cac2d3e tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:33.370251 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-dcd1bc29-eda9-4e20-945b-8b272cac2d3e tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: a3f6b512-e3cb-4e87-8d82-c64f6f1640db] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:33.377172 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-dcd1bc29-eda9-4e20-945b-8b272cac2d3e tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:33.377624 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-dcd1bc29-eda9-4e20-945b-8b272cac2d3e tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:33.378412 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-dcd1bc29-eda9-4e20-945b-8b272cac2d3e tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:33.378839 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-dcd1bc29-eda9-4e20-945b-8b272cac2d3e tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:33.405288 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-e8fff09a-d02f-47e9-aae0-11f6b547a95c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:33.405896 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-e8fff09a-d02f-47e9-aae0-11f6b547a95c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:33.413970 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-e8fff09a-d02f-47e9-aae0-11f6b547a95c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:33.414425 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-e8fff09a-d02f-47e9-aae0-11f6b547a95c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:33.415216 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-e8fff09a-d02f-47e9-aae0-11f6b547a95c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:33.415647 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-e8fff09a-d02f-47e9-aae0-11f6b547a95c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:33.697823 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-dcd1bc29-eda9-4e20-945b-8b272cac2d3e tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0aed0278344119aae6906f4f52b1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b66d46c3e7d42b88f2dbdc01232fb03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:33.703326 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-e8fff09a-d02f-47e9-aae0-11f6b547a95c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:33.707281 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-dcd1bc29-eda9-4e20-945b-8b272cac2d3e tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db" status: 200 len: 1698 microversion: 2.1 time: 0.342078 Aug 01 16:41:33.708110 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 168/328] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:33 2022] GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db => generated 1698 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:33.713196 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-8e3cab54-c2b0-4db0-86fc-d07c48ce2b24 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:33.713999 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-8e3cab54-c2b0-4db0-86fc-d07c48ce2b24 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 53e1f340-623b-4453-8735-db4701fef4ad] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:33.720535 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-8e3cab54-c2b0-4db0-86fc-d07c48ce2b24 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:33.720960 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-8e3cab54-c2b0-4db0-86fc-d07c48ce2b24 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:33.721765 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-8e3cab54-c2b0-4db0-86fc-d07c48ce2b24 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:33.722186 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-8e3cab54-c2b0-4db0-86fc-d07c48ce2b24 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:33.729256 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-e8fff09a-d02f-47e9-aae0-11f6b547a95c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:33.731504 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-e8fff09a-d02f-47e9-aae0-11f6b547a95c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:33.732839 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-e8fff09a-d02f-47e9-aae0-11f6b547a95c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1745 microversion: 2.20 time: 0.331519 Aug 01 16:41:33.740759 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 161/329] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:41:33 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1745 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:41:33.745270 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-a5261893-84f5-4962-a6ef-b2b615ee4418 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:33.746353 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-a5261893-84f5-4962-a6ef-b2b615ee4418 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: ddf9be16-b3ce-411b-ac14-17dae5f41821] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:33.753637 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-a5261893-84f5-4962-a6ef-b2b615ee4418 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:33.754188 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-a5261893-84f5-4962-a6ef-b2b615ee4418 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:33.755424 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-a5261893-84f5-4962-a6ef-b2b615ee4418 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:33.756012 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-a5261893-84f5-4962-a6ef-b2b615ee4418 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:33.805529 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-8e3cab54-c2b0-4db0-86fc-d07c48ce2b24 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac7d3acf1204a9f98f9ee14c2b46a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f46e472f8614c5e847ceb225cc9bff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:33.813572 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-8e3cab54-c2b0-4db0-86fc-d07c48ce2b24 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/53e1f340-623b-4453-8735-db4701fef4ad" status: 200 len: 1298 microversion: 2.1 time: 0.104259 Aug 01 16:41:33.814250 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 169/330] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:33 2022] GET /compute/v2.1/servers/53e1f340-623b-4453-8735-db4701fef4ad => generated 1298 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:33.819916 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-dde752fb-9c7e-4c74-8f23-adcb45d6d4e9 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:41:33.826064 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-dde752fb-9c7e-4c74-8f23-adcb45d6d4e9 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:33.826710 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-dde752fb-9c7e-4c74-8f23-adcb45d6d4e9 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:33.853685 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-dde752fb-9c7e-4c74-8f23-adcb45d6d4e9 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: a3f6b512-e3cb-4e87-8d82-c64f6f1640db] Going to try to start instance {{(pid=118118) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 01 16:41:33.909345 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-dde752fb-9c7e-4c74-8f23-adcb45d6d4e9 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "POST /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db/action" status: 202 len: 0 microversion: 2.1 time: 0.093624 Aug 01 16:41:33.909967 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 170/331] 10.222.0.45 () {60 vars in 1278 bytes} [Mon Aug 1 16:41:33 2022] POST /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 16:41:33.915738 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-6490b282-cc5e-442e-8c99-c513d467aef5 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:33.916465 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-6490b282-cc5e-442e-8c99-c513d467aef5 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] [instance: 879465e3-1ea1-4193-aa67-f1648076f9c2] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:33.923461 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-6490b282-cc5e-442e-8c99-c513d467aef5 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:33.923947 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-6490b282-cc5e-442e-8c99-c513d467aef5 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:33.924732 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-6490b282-cc5e-442e-8c99-c513d467aef5 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:33.925151 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-6490b282-cc5e-442e-8c99-c513d467aef5 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:34.326673 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_cell0:SELECT=2 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:41:34.498251 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-a5261893-84f5-4962-a6ef-b2b615ee4418 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:34.499366 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_cell0:SELECT=8 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:41:34.507494 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-a5261893-84f5-4962-a6ef-b2b615ee4418 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/ddf9be16-b3ce-411b-ac14-17dae5f41821" status: 200 len: 1521 microversion: 2.1 time: 0.772668 Aug 01 16:41:34.508112 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 162/332] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:33 2022] GET /compute/v2.1/servers/ddf9be16-b3ce-411b-ac14-17dae5f41821 => generated 1521 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:34.513608 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-561635f6-fd2d-4e80-9f10-9ad8d18f2cf4 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:34.514237 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-561635f6-fd2d-4e80-9f10-9ad8d18f2cf4 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: a3f6b512-e3cb-4e87-8d82-c64f6f1640db] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:34.521369 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-561635f6-fd2d-4e80-9f10-9ad8d18f2cf4 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:34.521882 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-561635f6-fd2d-4e80-9f10-9ad8d18f2cf4 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:34.522664 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-561635f6-fd2d-4e80-9f10-9ad8d18f2cf4 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:34.523099 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-561635f6-fd2d-4e80-9f10-9ad8d18f2cf4 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:34.578671 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-6490b282-cc5e-442e-8c99-c513d467aef5 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a8231119f34ef98b8a85303c5c447e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08c78acd1db446bac4352f66e792085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:34.586773 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-6490b282-cc5e-442e-8c99-c513d467aef5 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] 10.222.0.45 "GET /compute/v2.1/servers/879465e3-1ea1-4193-aa67-f1648076f9c2" status: 200 len: 1498 microversion: 2.1 time: 0.675365 Aug 01 16:41:34.587341 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 171/333] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:33 2022] GET /compute/v2.1/servers/879465e3-1ea1-4193-aa67-f1648076f9c2 => generated 1498 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:34.759216 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-128b5619-2339-46a4-a533-32a0641afc1e tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:34.759817 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-128b5619-2339-46a4-a533-32a0641afc1e tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:34.767834 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-128b5619-2339-46a4-a533-32a0641afc1e tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:34.768337 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-128b5619-2339-46a4-a533-32a0641afc1e tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:34.769154 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-128b5619-2339-46a4-a533-32a0641afc1e tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:34.769580 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-128b5619-2339-46a4-a533-32a0641afc1e tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:34.985740 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-561635f6-fd2d-4e80-9f10-9ad8d18f2cf4 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0aed0278344119aae6906f4f52b1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b66d46c3e7d42b88f2dbdc01232fb03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:34.994646 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-561635f6-fd2d-4e80-9f10-9ad8d18f2cf4 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db" status: 200 len: 1707 microversion: 2.1 time: 0.485440 Aug 01 16:41:34.995212 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 163/334] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:34 2022] GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db => generated 1707 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:35.005129 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-73efec86-fdd1-4198-b009-5a0d5e5c51d3 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:35.005129 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-73efec86-fdd1-4198-b009-5a0d5e5c51d3 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 53e1f340-623b-4453-8735-db4701fef4ad] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:35.015813 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-73efec86-fdd1-4198-b009-5a0d5e5c51d3 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:35.016847 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-73efec86-fdd1-4198-b009-5a0d5e5c51d3 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:35.017635 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-73efec86-fdd1-4198-b009-5a0d5e5c51d3 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:35.018060 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-73efec86-fdd1-4198-b009-5a0d5e5c51d3 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:35.189056 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-73efec86-fdd1-4198-b009-5a0d5e5c51d3 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac7d3acf1204a9f98f9ee14c2b46a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f46e472f8614c5e847ceb225cc9bff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:35.197167 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-73efec86-fdd1-4198-b009-5a0d5e5c51d3 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/53e1f340-623b-4453-8735-db4701fef4ad" status: 200 len: 1298 microversion: 2.1 time: 0.200683 Aug 01 16:41:35.197891 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 164/335] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:34 2022] GET /compute/v2.1/servers/53e1f340-623b-4453-8735-db4701fef4ad => generated 1298 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:35.206588 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-080e00d5-72c6-47d6-bb71-bc2b65ad1150 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:35.206588 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-080e00d5-72c6-47d6-bb71-bc2b65ad1150 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] [instance: 879465e3-1ea1-4193-aa67-f1648076f9c2] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:35.209659 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-080e00d5-72c6-47d6-bb71-bc2b65ad1150 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:35.210395 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-080e00d5-72c6-47d6-bb71-bc2b65ad1150 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:35.211375 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-080e00d5-72c6-47d6-bb71-bc2b65ad1150 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:35.211829 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-080e00d5-72c6-47d6-bb71-bc2b65ad1150 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:35.234963 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-128b5619-2339-46a4-a533-32a0641afc1e tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:35.244553 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-128b5619-2339-46a4-a533-32a0641afc1e tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:35.245589 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-080e00d5-72c6-47d6-bb71-bc2b65ad1150 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] [instance: 879465e3-1ea1-4193-aa67-f1648076f9c2] Going to try to terminate instance {{(pid=118117) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 16:41:35.247113 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-128b5619-2339-46a4-a533-32a0641afc1e tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:35.248749 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-128b5619-2339-46a4-a533-32a0641afc1e tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1745 microversion: 2.20 time: 0.493856 Aug 01 16:41:35.249539 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 172/336] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:41:34 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1745 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 16:41:35.333985 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-080e00d5-72c6-47d6-bb71-bc2b65ad1150 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] 10.222.0.45 "DELETE /compute/v2.1/servers/879465e3-1ea1-4193-aa67-f1648076f9c2" status: 204 len: 0 microversion: 2.1 time: 0.134734 Aug 01 16:41:35.335732 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 165/337] 10.222.0.45 () {58 vars in 1239 bytes} [Mon Aug 1 16:41:35 2022] DELETE /compute/v2.1/servers/879465e3-1ea1-4193-aa67-f1648076f9c2 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 16:41:35.344679 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-51771671-a62a-40c5-b3b3-8877dfb48c22 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:35.345651 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-51771671-a62a-40c5-b3b3-8877dfb48c22 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] [instance: 879465e3-1ea1-4193-aa67-f1648076f9c2] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:35.353538 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-51771671-a62a-40c5-b3b3-8877dfb48c22 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:35.353973 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-51771671-a62a-40c5-b3b3-8877dfb48c22 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:35.355223 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-51771671-a62a-40c5-b3b3-8877dfb48c22 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:35.355653 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-51771671-a62a-40c5-b3b3-8877dfb48c22 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:35.537422 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-1badfa03-de0a-4b38-88de-07a3798f2ff7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:35.538897 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-1badfa03-de0a-4b38-88de-07a3798f2ff7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: ddf9be16-b3ce-411b-ac14-17dae5f41821] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:35.552063 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-1badfa03-de0a-4b38-88de-07a3798f2ff7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:35.553391 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-1badfa03-de0a-4b38-88de-07a3798f2ff7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:35.554793 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-1badfa03-de0a-4b38-88de-07a3798f2ff7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:35.555415 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-1badfa03-de0a-4b38-88de-07a3798f2ff7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:35.753115 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-51771671-a62a-40c5-b3b3-8877dfb48c22 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a8231119f34ef98b8a85303c5c447e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08c78acd1db446bac4352f66e792085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:35.762173 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-51771671-a62a-40c5-b3b3-8877dfb48c22 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] 10.222.0.45 "GET /compute/v2.1/servers/879465e3-1ea1-4193-aa67-f1648076f9c2" status: 200 len: 1504 microversion: 2.1 time: 0.421743 Aug 01 16:41:35.763802 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 173/338] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:35 2022] GET /compute/v2.1/servers/879465e3-1ea1-4193-aa67-f1648076f9c2 => generated 1504 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:35.945847 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-1badfa03-de0a-4b38-88de-07a3798f2ff7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:35.954574 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-1badfa03-de0a-4b38-88de-07a3798f2ff7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/ddf9be16-b3ce-411b-ac14-17dae5f41821" status: 200 len: 1521 microversion: 2.1 time: 0.427301 Aug 01 16:41:35.955445 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 166/339] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:35 2022] GET /compute/v2.1/servers/ddf9be16-b3ce-411b-ac14-17dae5f41821 => generated 1521 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:36.019324 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-5b6bbc50-6a46-44d8-9bf7-4e5358336695 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:36.019324 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-5b6bbc50-6a46-44d8-9bf7-4e5358336695 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: a3f6b512-e3cb-4e87-8d82-c64f6f1640db] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:36.033305 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-5b6bbc50-6a46-44d8-9bf7-4e5358336695 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:36.034338 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-5b6bbc50-6a46-44d8-9bf7-4e5358336695 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:36.035276 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-5b6bbc50-6a46-44d8-9bf7-4e5358336695 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:36.035798 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-5b6bbc50-6a46-44d8-9bf7-4e5358336695 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:36.231395 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-e7d16db4-98b5-44e0-9b7a-d706444ec187 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:36.231917 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-e7d16db4-98b5-44e0-9b7a-d706444ec187 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 53e1f340-623b-4453-8735-db4701fef4ad] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:36.238628 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-e7d16db4-98b5-44e0-9b7a-d706444ec187 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:36.239073 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-e7d16db4-98b5-44e0-9b7a-d706444ec187 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:36.240095 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-e7d16db4-98b5-44e0-9b7a-d706444ec187 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:36.240753 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-e7d16db4-98b5-44e0-9b7a-d706444ec187 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:36.336126 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-5b6bbc50-6a46-44d8-9bf7-4e5358336695 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0aed0278344119aae6906f4f52b1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b66d46c3e7d42b88f2dbdc01232fb03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:36.345253 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-5b6bbc50-6a46-44d8-9bf7-4e5358336695 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db" status: 200 len: 1707 microversion: 2.1 time: 0.331204 Aug 01 16:41:36.345926 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 174/340] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:36 2022] GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db => generated 1707 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:36.351226 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-e6dc91be-2799-40fb-b0bd-d7d055e891cf tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:36.352189 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-e6dc91be-2799-40fb-b0bd-d7d055e891cf tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:36.358636 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-e6dc91be-2799-40fb-b0bd-d7d055e891cf tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:36.359083 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-e6dc91be-2799-40fb-b0bd-d7d055e891cf tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:36.360657 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-e6dc91be-2799-40fb-b0bd-d7d055e891cf tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:36.361115 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-e6dc91be-2799-40fb-b0bd-d7d055e891cf tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:36.503316 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-e7d16db4-98b5-44e0-9b7a-d706444ec187 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac7d3acf1204a9f98f9ee14c2b46a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f46e472f8614c5e847ceb225cc9bff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:36.511258 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-e7d16db4-98b5-44e0-9b7a-d706444ec187 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/53e1f340-623b-4453-8735-db4701fef4ad" status: 200 len: 1366 microversion: 2.1 time: 0.284048 Aug 01 16:41:36.511853 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 167/341] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:36 2022] GET /compute/v2.1/servers/53e1f340-623b-4453-8735-db4701fef4ad => generated 1366 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:36.647973 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-e6dc91be-2799-40fb-b0bd-d7d055e891cf tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:36.656832 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-e6dc91be-2799-40fb-b0bd-d7d055e891cf tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:36.658312 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-e6dc91be-2799-40fb-b0bd-d7d055e891cf tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:36.659463 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-e6dc91be-2799-40fb-b0bd-d7d055e891cf tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1745 microversion: 2.20 time: 0.312534 Aug 01 16:41:36.660054 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 175/342] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:41:36 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1745 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:41:36.785148 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-d2481d89-808f-446f-9541-4f81431845df tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:36.785628 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-d2481d89-808f-446f-9541-4f81431845df tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] [instance: 879465e3-1ea1-4193-aa67-f1648076f9c2] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:36.800701 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-d2481d89-808f-446f-9541-4f81431845df tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:36.801518 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-d2481d89-808f-446f-9541-4f81431845df tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:36.802284 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-d2481d89-808f-446f-9541-4f81431845df tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:36.802795 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-d2481d89-808f-446f-9541-4f81431845df tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:36.978127 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-fb794810-dd4a-4448-9459-5931f2aa71b0 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:36.979679 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-fb794810-dd4a-4448-9459-5931f2aa71b0 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: ddf9be16-b3ce-411b-ac14-17dae5f41821] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:36.986470 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-fb794810-dd4a-4448-9459-5931f2aa71b0 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:36.987282 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-fb794810-dd4a-4448-9459-5931f2aa71b0 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:36.988457 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-fb794810-dd4a-4448-9459-5931f2aa71b0 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:36.989316 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-fb794810-dd4a-4448-9459-5931f2aa71b0 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:36.992640 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:41:37.221406 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-d2481d89-808f-446f-9541-4f81431845df tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a8231119f34ef98b8a85303c5c447e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08c78acd1db446bac4352f66e792085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:37.230291 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-d2481d89-808f-446f-9541-4f81431845df tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] 10.222.0.45 "GET /compute/v2.1/servers/879465e3-1ea1-4193-aa67-f1648076f9c2" status: 200 len: 1504 microversion: 2.1 time: 0.449629 Aug 01 16:41:37.231235 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 168/343] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:36 2022] GET /compute/v2.1/servers/879465e3-1ea1-4193-aa67-f1648076f9c2 => generated 1504 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:37.278591 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-fb794810-dd4a-4448-9459-5931f2aa71b0 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:37.286431 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-fb794810-dd4a-4448-9459-5931f2aa71b0 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/ddf9be16-b3ce-411b-ac14-17dae5f41821" status: 200 len: 1521 microversion: 2.1 time: 0.312997 Aug 01 16:41:37.287001 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 176/344] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:36 2022] GET /compute/v2.1/servers/ddf9be16-b3ce-411b-ac14-17dae5f41821 => generated 1521 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:37.367478 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-4b6b46a2-cfd0-4f76-a07b-106169537548 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:37.368116 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-4b6b46a2-cfd0-4f76-a07b-106169537548 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: a3f6b512-e3cb-4e87-8d82-c64f6f1640db] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:37.374309 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-4b6b46a2-cfd0-4f76-a07b-106169537548 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:37.374749 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-4b6b46a2-cfd0-4f76-a07b-106169537548 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:37.375929 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-4b6b46a2-cfd0-4f76-a07b-106169537548 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:37.376545 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-4b6b46a2-cfd0-4f76-a07b-106169537548 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:37.379661 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:41:37.543837 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-93445376-5673-47e4-930e-f23cf3243e2e tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:37.544449 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-93445376-5673-47e4-930e-f23cf3243e2e tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 53e1f340-623b-4453-8735-db4701fef4ad] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:37.554022 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-93445376-5673-47e4-930e-f23cf3243e2e tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:37.554472 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-93445376-5673-47e4-930e-f23cf3243e2e tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:37.555257 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-93445376-5673-47e4-930e-f23cf3243e2e tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:37.555699 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-93445376-5673-47e4-930e-f23cf3243e2e tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:37.629818 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-4b6b46a2-cfd0-4f76-a07b-106169537548 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0aed0278344119aae6906f4f52b1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b66d46c3e7d42b88f2dbdc01232fb03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:37.640494 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-4b6b46a2-cfd0-4f76-a07b-106169537548 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db" status: 200 len: 1707 microversion: 2.1 time: 0.276707 Aug 01 16:41:37.642752 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 169/345] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:37 2022] GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db => generated 1707 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:37.676494 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [req-fbdde83d-9179-4c86-af89-76d2e8fc66bd req-ec4cb633-ff76-4034-bd9d-198e63c72e30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1c8ed71-ea21-4bca-91bf-febe7457300e", "name": "network-vif-plugged", "status": "completed", "tag": "734cefe8-e715-4af3-bebc-f135e61eb70c"}]} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:41:37.692413 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-fbdde83d-9179-4c86-af89-76d2e8fc66bd req-ec4cb633-ff76-4034-bd9d-198e63c72e30 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:37.693324 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-fbdde83d-9179-4c86-af89-76d2e8fc66bd req-ec4cb633-ff76-4034-bd9d-198e63c72e30 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:37.708576 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.compute.server_external_events [req-fbdde83d-9179-4c86-af89-76d2e8fc66bd req-ec4cb633-ff76-4034-bd9d-198e63c72e30 service nova] Creating event network-vif-plugged:734cefe8-e715-4af3-bebc-f135e61eb70c for instance f1c8ed71-ea21-4bca-91bf-febe7457300e on hv-cinder-85032 Aug 01 16:41:37.713960 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [req-fbdde83d-9179-4c86-af89-76d2e8fc66bd req-ec4cb633-ff76-4034-bd9d-198e63c72e30 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044132 Aug 01 16:41:37.714681 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 170/346] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:41:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:41:37.733979 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-e9383d6a-996b-4d3a-beae-c9029bfa336c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:37.734805 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-e9383d6a-996b-4d3a-beae-c9029bfa336c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:37.742419 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-e9383d6a-996b-4d3a-beae-c9029bfa336c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:37.743167 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-e9383d6a-996b-4d3a-beae-c9029bfa336c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:37.744177 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-e9383d6a-996b-4d3a-beae-c9029bfa336c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:37.744812 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-e9383d6a-996b-4d3a-beae-c9029bfa336c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:37.854264 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-93445376-5673-47e4-930e-f23cf3243e2e tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac7d3acf1204a9f98f9ee14c2b46a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f46e472f8614c5e847ceb225cc9bff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:37.864506 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-93445376-5673-47e4-930e-f23cf3243e2e tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/53e1f340-623b-4453-8735-db4701fef4ad" status: 200 len: 1366 microversion: 2.1 time: 0.335454 Aug 01 16:41:37.876610 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 177/347] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:37 2022] GET /compute/v2.1/servers/53e1f340-623b-4453-8735-db4701fef4ad => generated 1366 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:37.885716 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [req-a044649d-3130-43b2-b399-7d00b661f1fa req-2e98582b-88e8-4998-a4e9-34d295adea76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "348b2621-1bf9-431b-b639-9aabbf68a3cf", "tag": "8967f796-0a7a-4c6f-b2f7-18a05072b7c4"}]} {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:41:37.897238 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-a044649d-3130-43b2-b399-7d00b661f1fa req-2e98582b-88e8-4998-a4e9-34d295adea76 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:37.897709 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-a044649d-3130-43b2-b399-7d00b661f1fa req-2e98582b-88e8-4998-a4e9-34d295adea76 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:37.911740 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.compute.server_external_events [req-a044649d-3130-43b2-b399-7d00b661f1fa req-2e98582b-88e8-4998-a4e9-34d295adea76 service nova] Creating event network-changed:8967f796-0a7a-4c6f-b2f7-18a05072b7c4 for instance 348b2621-1bf9-431b-b639-9aabbf68a3cf on hv-cinder-85032 Aug 01 16:41:37.918134 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [req-a044649d-3130-43b2-b399-7d00b661f1fa req-2e98582b-88e8-4998-a4e9-34d295adea76 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039564 Aug 01 16:41:37.919149 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 178/348] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:41:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:41:37.968510 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-e9383d6a-996b-4d3a-beae-c9029bfa336c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:37.991418 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-e9383d6a-996b-4d3a-beae-c9029bfa336c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:37.992984 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-e9383d6a-996b-4d3a-beae-c9029bfa336c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:37.994176 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-e9383d6a-996b-4d3a-beae-c9029bfa336c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1745 microversion: 2.20 time: 0.278046 Aug 01 16:41:37.994741 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 171/349] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:41:37 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1745 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:41:38.252742 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-de0a474c-d333-421c-bc63-ae5c80a081d3 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:38.253447 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-de0a474c-d333-421c-bc63-ae5c80a081d3 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] [instance: 879465e3-1ea1-4193-aa67-f1648076f9c2] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:38.261112 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-de0a474c-d333-421c-bc63-ae5c80a081d3 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:38.261781 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-de0a474c-d333-421c-bc63-ae5c80a081d3 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:38.262719 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-de0a474c-d333-421c-bc63-ae5c80a081d3 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:38.263403 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-de0a474c-d333-421c-bc63-ae5c80a081d3 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:38.308695 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-07fd0281-5efe-4d7d-8c07-2181b5ec45c4 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:38.309786 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-07fd0281-5efe-4d7d-8c07-2181b5ec45c4 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: ddf9be16-b3ce-411b-ac14-17dae5f41821] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:38.316778 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-07fd0281-5efe-4d7d-8c07-2181b5ec45c4 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:38.317592 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-07fd0281-5efe-4d7d-8c07-2181b5ec45c4 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:38.318654 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-07fd0281-5efe-4d7d-8c07-2181b5ec45c4 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:38.319377 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-07fd0281-5efe-4d7d-8c07-2181b5ec45c4 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:38.581721 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-de0a474c-d333-421c-bc63-ae5c80a081d3 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a8231119f34ef98b8a85303c5c447e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08c78acd1db446bac4352f66e792085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:38.589058 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-07fd0281-5efe-4d7d-8c07-2181b5ec45c4 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:38.591926 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-de0a474c-d333-421c-bc63-ae5c80a081d3 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] 10.222.0.45 "GET /compute/v2.1/servers/879465e3-1ea1-4193-aa67-f1648076f9c2" status: 200 len: 1504 microversion: 2.1 time: 0.344027 Aug 01 16:41:38.600775 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 179/350] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:38 2022] GET /compute/v2.1/servers/879465e3-1ea1-4193-aa67-f1648076f9c2 => generated 1504 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:38.619078 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-07fd0281-5efe-4d7d-8c07-2181b5ec45c4 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/ddf9be16-b3ce-411b-ac14-17dae5f41821" status: 200 len: 1521 microversion: 2.1 time: 0.314161 Aug 01 16:41:38.628809 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 172/351] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:38 2022] GET /compute/v2.1/servers/ddf9be16-b3ce-411b-ac14-17dae5f41821 => generated 1521 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:38.664589 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-3c8768fd-5169-474e-9ece-13d9514c62d9 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:38.665695 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-3c8768fd-5169-474e-9ece-13d9514c62d9 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: a3f6b512-e3cb-4e87-8d82-c64f6f1640db] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:38.690090 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3c8768fd-5169-474e-9ece-13d9514c62d9 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:38.690833 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3c8768fd-5169-474e-9ece-13d9514c62d9 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:38.691913 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3c8768fd-5169-474e-9ece-13d9514c62d9 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:38.692722 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3c8768fd-5169-474e-9ece-13d9514c62d9 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:38.892069 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-67ebad39-4ec3-4536-a009-c938986df8fd tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:38.893151 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-67ebad39-4ec3-4536-a009-c938986df8fd tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 53e1f340-623b-4453-8735-db4701fef4ad] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:38.901874 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-67ebad39-4ec3-4536-a009-c938986df8fd tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:38.902904 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-67ebad39-4ec3-4536-a009-c938986df8fd tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:38.903911 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-67ebad39-4ec3-4536-a009-c938986df8fd tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:38.904702 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-67ebad39-4ec3-4536-a009-c938986df8fd tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:38.918019 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-3c8768fd-5169-474e-9ece-13d9514c62d9 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0aed0278344119aae6906f4f52b1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b66d46c3e7d42b88f2dbdc01232fb03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:38.928221 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-3c8768fd-5169-474e-9ece-13d9514c62d9 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db" status: 200 len: 1707 microversion: 2.1 time: 0.268094 Aug 01 16:41:38.929185 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 180/352] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:38 2022] GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db => generated 1707 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:39.019223 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-acf56ee2-74e0-4632-82f4-5f1a5b0bc59d tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:39.020501 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-acf56ee2-74e0-4632-82f4-5f1a5b0bc59d tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:39.031201 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-acf56ee2-74e0-4632-82f4-5f1a5b0bc59d tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:39.031911 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-acf56ee2-74e0-4632-82f4-5f1a5b0bc59d tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:39.033259 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-acf56ee2-74e0-4632-82f4-5f1a5b0bc59d tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:39.034120 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-acf56ee2-74e0-4632-82f4-5f1a5b0bc59d tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:39.102460 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-67ebad39-4ec3-4536-a009-c938986df8fd tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac7d3acf1204a9f98f9ee14c2b46a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f46e472f8614c5e847ceb225cc9bff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:39.111664 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-67ebad39-4ec3-4536-a009-c938986df8fd tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/53e1f340-623b-4453-8735-db4701fef4ad" status: 200 len: 1366 microversion: 2.1 time: 0.225227 Aug 01 16:41:39.112444 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 173/353] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:38 2022] GET /compute/v2.1/servers/53e1f340-623b-4453-8735-db4701fef4ad => generated 1366 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:41:39.132147 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-5694f4e5-911f-46c9-89d7-9cae03b58a06 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1013811994"}} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:41:39.133173 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-5694f4e5-911f-46c9-89d7-9cae03b58a06 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] [instance: 348b2621-1bf9-431b-b639-9aabbf68a3cf] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:39.140334 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-5694f4e5-911f-46c9-89d7-9cae03b58a06 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:39.141498 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-5694f4e5-911f-46c9-89d7-9cae03b58a06 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:39.142627 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-5694f4e5-911f-46c9-89d7-9cae03b58a06 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:39.143116 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-5694f4e5-911f-46c9-89d7-9cae03b58a06 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:39.263595 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-acf56ee2-74e0-4632-82f4-5f1a5b0bc59d tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:39.274467 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-acf56ee2-74e0-4632-82f4-5f1a5b0bc59d tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:39.276934 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-acf56ee2-74e0-4632-82f4-5f1a5b0bc59d tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:39.278683 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-acf56ee2-74e0-4632-82f4-5f1a5b0bc59d tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1745 microversion: 2.20 time: 0.264598 Aug 01 16:41:39.279914 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 181/354] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:41:39 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1745 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:41:39.464675 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.network.security_group_api [None req-5694f4e5-911f-46c9-89d7-9cae03b58a06 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Adding security group 7a825f82-e0e8-47f2-8dae-f903565c61ce to port 8967f796-0a7a-4c6f-b2f7-18a05072b7c4 Aug 01 16:41:39.646404 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-a250231e-0d2b-4565-81f4-defe51318e07 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:39.647037 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-a250231e-0d2b-4565-81f4-defe51318e07 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: ddf9be16-b3ce-411b-ac14-17dae5f41821] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:39.654679 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a250231e-0d2b-4565-81f4-defe51318e07 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:39.655802 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a250231e-0d2b-4565-81f4-defe51318e07 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:39.657086 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a250231e-0d2b-4565-81f4-defe51318e07 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:39.657704 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a250231e-0d2b-4565-81f4-defe51318e07 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:40.397268 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-a250231e-0d2b-4565-81f4-defe51318e07 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:40.438397 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-a250231e-0d2b-4565-81f4-defe51318e07 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/ddf9be16-b3ce-411b-ac14-17dae5f41821" status: 200 len: 1521 microversion: 2.1 time: 0.796235 Aug 01 16:41:40.439745 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 182/355] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:39 2022] GET /compute/v2.1/servers/ddf9be16-b3ce-411b-ac14-17dae5f41821 => generated 1521 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:41:40.462034 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-5fbae696-8027-401c-acd1-76b239d144f9 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:40.464207 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-5fbae696-8027-401c-acd1-76b239d144f9 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] [instance: 879465e3-1ea1-4193-aa67-f1648076f9c2] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:40.480669 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-5fbae696-8027-401c-acd1-76b239d144f9 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:40.481140 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-5fbae696-8027-401c-acd1-76b239d144f9 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:40.481919 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-5fbae696-8027-401c-acd1-76b239d144f9 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:40.482340 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-5fbae696-8027-401c-acd1-76b239d144f9 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:41.273995 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-5694f4e5-911f-46c9-89d7-9cae03b58a06 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] 10.222.0.45 "POST /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf/action" status: 202 len: 0 microversion: 2.1 time: 2.146473 Aug 01 16:41:41.275530 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 174/356] 10.222.0.45 () {60 vars in 1278 bytes} [Mon Aug 1 16:41:39 2022] POST /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf/action => generated 0 bytes in 2162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 16:41:41.285995 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-fc3eb1bb-428d-4ecc-9a72-87a62bb943a0 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:41.289215 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-fc3eb1bb-428d-4ecc-9a72-87a62bb943a0 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: a3f6b512-e3cb-4e87-8d82-c64f6f1640db] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:41.319193 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-fc3eb1bb-428d-4ecc-9a72-87a62bb943a0 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:41.321322 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-fc3eb1bb-428d-4ecc-9a72-87a62bb943a0 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:41.324953 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-fc3eb1bb-428d-4ecc-9a72-87a62bb943a0 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:41.327326 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-fc3eb1bb-428d-4ecc-9a72-87a62bb943a0 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:41.351532 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-5fbae696-8027-401c-acd1-76b239d144f9 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a8231119f34ef98b8a85303c5c447e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08c78acd1db446bac4352f66e792085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:41.392542 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-5fbae696-8027-401c-acd1-76b239d144f9 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] 10.222.0.45 "GET /compute/v2.1/servers/879465e3-1ea1-4193-aa67-f1648076f9c2" status: 200 len: 1504 microversion: 2.1 time: 0.946060 Aug 01 16:41:41.395574 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 183/357] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:40 2022] GET /compute/v2.1/servers/879465e3-1ea1-4193-aa67-f1648076f9c2 => generated 1504 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:41.421620 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-c20bba56-cc00-433c-8ba6-f416cd076280 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:41.423822 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-c20bba56-cc00-433c-8ba6-f416cd076280 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 53e1f340-623b-4453-8735-db4701fef4ad] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:41.452507 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-c20bba56-cc00-433c-8ba6-f416cd076280 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:41.455192 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-c20bba56-cc00-433c-8ba6-f416cd076280 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:41.460275 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-c20bba56-cc00-433c-8ba6-f416cd076280 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:41.462813 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-c20bba56-cc00-433c-8ba6-f416cd076280 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:42.043442 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-fc3eb1bb-428d-4ecc-9a72-87a62bb943a0 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0aed0278344119aae6906f4f52b1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b66d46c3e7d42b88f2dbdc01232fb03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:42.097113 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-fc3eb1bb-428d-4ecc-9a72-87a62bb943a0 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db" status: 200 len: 1707 microversion: 2.1 time: 0.818951 Aug 01 16:41:42.102537 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 175/358] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:41 2022] GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db => generated 1707 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:42.123174 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-171c0f7a-7708-4f2c-a377-123a5c89517c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:42.130643 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-c20bba56-cc00-433c-8ba6-f416cd076280 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac7d3acf1204a9f98f9ee14c2b46a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f46e472f8614c5e847ceb225cc9bff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:42.142698 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-c20bba56-cc00-433c-8ba6-f416cd076280 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/53e1f340-623b-4453-8735-db4701fef4ad" status: 200 len: 1366 microversion: 2.1 time: 0.745292 Aug 01 16:41:42.143326 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 184/359] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:41 2022] GET /compute/v2.1/servers/53e1f340-623b-4453-8735-db4701fef4ad => generated 1366 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:42.149938 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-171c0f7a-7708-4f2c-a377-123a5c89517c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:42.207155 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-7af3d318-c9d7-4368-97df-64ac1484d41b tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:42.212449 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-171c0f7a-7708-4f2c-a377-123a5c89517c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:42.214893 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-171c0f7a-7708-4f2c-a377-123a5c89517c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:42.215342 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-7af3d318-c9d7-4368-97df-64ac1484d41b tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] [instance: 348b2621-1bf9-431b-b639-9aabbf68a3cf] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:42.218829 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-171c0f7a-7708-4f2c-a377-123a5c89517c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:42.222712 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-171c0f7a-7708-4f2c-a377-123a5c89517c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:42.251974 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-7af3d318-c9d7-4368-97df-64ac1484d41b tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:42.252822 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-7af3d318-c9d7-4368-97df-64ac1484d41b tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:42.255967 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-7af3d318-c9d7-4368-97df-64ac1484d41b tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:42.259917 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-7af3d318-c9d7-4368-97df-64ac1484d41b tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:42.712545 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-171c0f7a-7708-4f2c-a377-123a5c89517c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:42.723445 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-171c0f7a-7708-4f2c-a377-123a5c89517c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:42.726959 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-171c0f7a-7708-4f2c-a377-123a5c89517c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:42.728777 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-171c0f7a-7708-4f2c-a377-123a5c89517c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1740 microversion: 2.20 time: 0.622394 Aug 01 16:41:42.729671 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 176/360] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:41:42 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1740 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:41:42.754442 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [req-e58e4808-0949-4da9-944b-2d4d25ee943d req-e9bc9a05-fb07-4e23-83f9-e9febd8c80ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "348b2621-1bf9-431b-b639-9aabbf68a3cf", "tag": "8967f796-0a7a-4c6f-b2f7-18a05072b7c4"}]} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:41:42.772971 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-e58e4808-0949-4da9-944b-2d4d25ee943d req-e9bc9a05-fb07-4e23-83f9-e9febd8c80ae service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:42.773790 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-e58e4808-0949-4da9-944b-2d4d25ee943d req-e9bc9a05-fb07-4e23-83f9-e9febd8c80ae service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:42.792172 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-7af3d318-c9d7-4368-97df-64ac1484d41b tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a95d9f48c64b0fbb8879d361bc177d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019734069da44b2d88561549bd07544d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:42.803742 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.compute.server_external_events [req-e58e4808-0949-4da9-944b-2d4d25ee943d req-e9bc9a05-fb07-4e23-83f9-e9febd8c80ae service nova] Creating event network-changed:8967f796-0a7a-4c6f-b2f7-18a05072b7c4 for instance 348b2621-1bf9-431b-b639-9aabbf68a3cf on hv-cinder-85032 Aug 01 16:41:42.804739 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-7af3d318-c9d7-4368-97df-64ac1484d41b tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] 10.222.0.45 "GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf" status: 200 len: 1760 microversion: 2.1 time: 0.639908 Aug 01 16:41:42.805345 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 185/361] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:42 2022] GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf => generated 1760 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:42.817601 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [req-e58e4808-0949-4da9-944b-2d4d25ee943d req-e9bc9a05-fb07-4e23-83f9-e9febd8c80ae service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068094 Aug 01 16:41:42.817601 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 177/362] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:41:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:41:42.829513 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-0d7efd9b-268f-4738-bb67-d061844cc562 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:42.830725 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-0d7efd9b-268f-4738-bb67-d061844cc562 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: ddf9be16-b3ce-411b-ac14-17dae5f41821] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:42.831831 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-fa811b66-de74-4ae7-bce9-658314a8f244 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:42.833366 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-fa811b66-de74-4ae7-bce9-658314a8f244 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] [instance: 879465e3-1ea1-4193-aa67-f1648076f9c2] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:42.843381 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-fa811b66-de74-4ae7-bce9-658314a8f244 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:42.844741 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-fa811b66-de74-4ae7-bce9-658314a8f244 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:42.845928 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-fa811b66-de74-4ae7-bce9-658314a8f244 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:42.846611 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-fa811b66-de74-4ae7-bce9-658314a8f244 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:42.849162 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-0d7efd9b-268f-4738-bb67-d061844cc562 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:42.849624 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-0d7efd9b-268f-4738-bb67-d061844cc562 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:42.850416 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-0d7efd9b-268f-4738-bb67-d061844cc562 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:42.850849 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-0d7efd9b-268f-4738-bb67-d061844cc562 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:42.889090 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-fa811b66-de74-4ae7-bce9-658314a8f244 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:42.889959 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-fa811b66-de74-4ae7-bce9-658314a8f244 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:42.890977 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.objects.instance [None req-fa811b66-de74-4ae7-bce9-658314a8f244 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lazy-loading 'fault' on Instance uuid 879465e3-1ea1-4193-aa67-f1648076f9c2 {{(pid=118118) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 16:41:42.989933 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-fa811b66-de74-4ae7-bce9-658314a8f244 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a8231119f34ef98b8a85303c5c447e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08c78acd1db446bac4352f66e792085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:43.006082 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-fa811b66-de74-4ae7-bce9-658314a8f244 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] 10.222.0.45 "GET /compute/v2.1/servers/879465e3-1ea1-4193-aa67-f1648076f9c2" status: 200 len: 1304 microversion: 2.1 time: 0.182790 Aug 01 16:41:43.008164 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 186/363] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:42 2022] GET /compute/v2.1/servers/879465e3-1ea1-4193-aa67-f1648076f9c2 => generated 1304 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:43.130294 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-95f65529-2253-45f6-8b1f-6b4286afd700 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:43.130945 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-95f65529-2253-45f6-8b1f-6b4286afd700 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: a3f6b512-e3cb-4e87-8d82-c64f6f1640db] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:43.146342 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-95f65529-2253-45f6-8b1f-6b4286afd700 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:43.148048 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-95f65529-2253-45f6-8b1f-6b4286afd700 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:43.148923 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-95f65529-2253-45f6-8b1f-6b4286afd700 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:43.149375 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-95f65529-2253-45f6-8b1f-6b4286afd700 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:43.366705 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-0d7efd9b-268f-4738-bb67-d061844cc562 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:43.377148 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-0d7efd9b-268f-4738-bb67-d061844cc562 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/ddf9be16-b3ce-411b-ac14-17dae5f41821" status: 200 len: 1521 microversion: 2.1 time: 0.561442 Aug 01 16:41:43.378234 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 178/364] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:42 2022] GET /compute/v2.1/servers/ddf9be16-b3ce-411b-ac14-17dae5f41821 => generated 1521 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:43.426458 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-f33e60d7-a324-4e12-9803-08356a734685 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:43.444572 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-f33e60d7-a324-4e12-9803-08356a734685 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 53e1f340-623b-4453-8735-db4701fef4ad] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:43.520233 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-f33e60d7-a324-4e12-9803-08356a734685 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:43.520233 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-f33e60d7-a324-4e12-9803-08356a734685 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:43.520510 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-f33e60d7-a324-4e12-9803-08356a734685 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:43.521024 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-f33e60d7-a324-4e12-9803-08356a734685 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:43.805752 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-95f65529-2253-45f6-8b1f-6b4286afd700 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0aed0278344119aae6906f4f52b1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b66d46c3e7d42b88f2dbdc01232fb03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:43.816641 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-95f65529-2253-45f6-8b1f-6b4286afd700 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db" status: 200 len: 1711 microversion: 2.1 time: 0.690397 Aug 01 16:41:43.818375 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 187/365] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:43 2022] GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db => generated 1711 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:43.825103 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-91adef80-59b1-44e0-b78c-360fdac7ab4f tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:43.826207 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-91adef80-59b1-44e0-b78c-360fdac7ab4f tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:43.837914 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-91adef80-59b1-44e0-b78c-360fdac7ab4f tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:43.838823 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-91adef80-59b1-44e0-b78c-360fdac7ab4f tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:43.840651 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-91adef80-59b1-44e0-b78c-360fdac7ab4f tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:43.841367 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-91adef80-59b1-44e0-b78c-360fdac7ab4f tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:43.989116 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-f33e60d7-a324-4e12-9803-08356a734685 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac7d3acf1204a9f98f9ee14c2b46a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f46e472f8614c5e847ceb225cc9bff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:43.998604 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-f33e60d7-a324-4e12-9803-08356a734685 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/53e1f340-623b-4453-8735-db4701fef4ad" status: 200 len: 1366 microversion: 2.1 time: 0.618897 Aug 01 16:41:43.999446 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 179/366] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:43 2022] GET /compute/v2.1/servers/53e1f340-623b-4453-8735-db4701fef4ad => generated 1366 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:44.032634 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-90165b4c-633f-4dd0-9757-0935f0fec4f9 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:44.036954 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-90165b4c-633f-4dd0-9757-0935f0fec4f9 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] [instance: 879465e3-1ea1-4193-aa67-f1648076f9c2] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:44.046495 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-90165b4c-633f-4dd0-9757-0935f0fec4f9 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:44.047250 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-90165b4c-633f-4dd0-9757-0935f0fec4f9 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:44.049438 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-90165b4c-633f-4dd0-9757-0935f0fec4f9 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:44.050891 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-90165b4c-633f-4dd0-9757-0935f0fec4f9 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:44.072777 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.wsgi [None req-90165b4c-633f-4dd0-9757-0935f0fec4f9 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] HTTP exception thrown: Instance 879465e3-1ea1-4193-aa67-f1648076f9c2 could not be found. Aug 01 16:41:44.076663 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-90165b4c-633f-4dd0-9757-0935f0fec4f9 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Request method failure captured: Aug 01 16:41:44.076663 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: request: GET /compute/v2.1/servers/879465e3-1ea1-4193-aa67-f1648076f9c2 HTTP/1.1 Aug 01 16:41:44.076663 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Accept: application/json Aug 01 16:41:44.076663 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Accept-Encoding: identity Aug 01 16:41:44.076663 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Connection: close Aug 01 16:41:44.076663 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Content-Length: 0 Aug 01 16:41:44.076663 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Content-Type: application/json Aug 01 16:41:44.076663 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Host: 10.222.0.45 Aug 01 16:41:44.076663 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Openstack-System-Scope: None Aug 01 16:41:44.076663 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: User-Agent: python-urllib3/1.26.10 Aug 01 16:41:44.076663 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Auth-Token: gAAAAABi6AImAXqc3uZ8HS3ewrS9aIT5p8qJrHuxKnKITPZU1_o-IQ5438Fx6izQHKmot2UF3xEH0272fwyNG_nc1e4P0Y6HKxYFa1x6y9ZfCxLFNzJ6QNMucQnIQRAngbOQ8q2QOyo2O8WqS1upXCsf5N83mXDOUxq7f4zGkYk-7c6XeMPuUhI Aug 01 16:41:44.076663 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Domain-Id: None Aug 01 16:41:44.076663 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Domain-Name: None Aug 01 16:41:44.076663 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Identity-Status: Confirmed Aug 01 16:41:44.076663 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Is-Admin-Project: True Aug 01 16:41:44.076663 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Domain-Id: default Aug 01 16:41:44.076663 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Domain-Name: Default Aug 01 16:41:44.076663 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Id: d08c78acd1db446bac4352f66e792085 Aug 01 16:41:44.076663 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Name: tempest-VolumesActionsTest-622644897 Aug 01 16:41:44.076663 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Role: reader,member Aug 01 16:41:44.076663 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Roles: reader,member Aug 01 16:41:44.078412 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_d08c78acd1db446bac4352f66e792085"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/d08c78acd1db446bac4352f66e792085"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d08c78acd1db446bac4352f66e792085"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d08c78acd1db446bac4352f66e792085"}]}] Aug 01 16:41:44.078412 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Tenant: tempest-VolumesActionsTest-622644897 Aug 01 16:41:44.078412 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Tenant-Id: d08c78acd1db446bac4352f66e792085 Aug 01 16:41:44.078412 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Tenant-Name: tempest-VolumesActionsTest-622644897 Aug 01 16:41:44.078412 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User: tempest-VolumesActionsTest-622644897-project Aug 01 16:41:44.078412 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Domain-Id: default Aug 01 16:41:44.078412 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Domain-Name: Default Aug 01 16:41:44.078412 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Id: c6a8231119f34ef98b8a85303c5c447e Aug 01 16:41:44.078412 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Name: tempest-VolumesActionsTest-622644897-project Aug 01 16:41:44.078412 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: method: > Aug 01 16:41:44.078412 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: exception: Instance 879465e3-1ea1-4193-aa67-f1648076f9c2 could not be found. Aug 01 16:41:44.078412 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: action_args: {'id': '879465e3-1ea1-4193-aa67-f1648076f9c2'} Aug 01 16:41:44.079311 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:41:44.079311 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:41:44.079311 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 16:41:44.079311 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 16:41:44.079311 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 16:41:44.079311 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 16:41:44.079311 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 16:41:44.079311 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 16:41:44.079311 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 16:41:44.079311 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 16:41:44.079311 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 879465e3-1ea1-4193-aa67-f1648076f9c2 could not be found. Aug 01 16:41:44.079311 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:41:44.079311 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:41:44.079311 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:41:44.079311 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:41:44.079311 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:41:44.079311 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:41:44.079311 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:41:44.079311 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:41:44.079311 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:41:44.080967 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:41:44.080967 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 16:41:44.080967 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 16:41:44.080967 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 16:41:44.080967 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 16:41:44.080967 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 16:41:44.080967 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:41:44.080967 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 879465e3-1ea1-4193-aa67-f1648076f9c2 could not be found. Aug 01 16:41:44.080967 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:41:44.080967 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:41:44.080967 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:41:44.080967 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:41:44.080967 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:41:44.080967 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:41:44.080967 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:41:44.080967 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:41:44.080967 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 879465e3-1ea1-4193-aa67-f1648076f9c2 could not be found. Aug 01 16:41:44.080967 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:41:44.088708 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-90165b4c-633f-4dd0-9757-0935f0fec4f9 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Returning 404 to user: Instance 879465e3-1ea1-4193-aa67-f1648076f9c2 could not be found. {{(pid=118117) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:41:44.089609 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-90165b4c-633f-4dd0-9757-0935f0fec4f9 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] 10.222.0.45 "GET /compute/v2.1/servers/879465e3-1ea1-4193-aa67-f1648076f9c2" status: 404 len: 111 microversion: 2.1 time: 0.063505 Aug 01 16:41:44.090184 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 180/367] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:44 2022] GET /compute/v2.1/servers/879465e3-1ea1-4193-aa67-f1648076f9c2 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 01 16:41:44.224202 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-68913535-a6d6-427c-b43b-dd39856676be tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2133810579", "imageRef": "c9cb5329-85cb-4472-935d-c4ea1d1f0592", "flavorRef": "452", "networks": [{"uuid": "ef5319c3-a335-4216-bb12-ed5b7339edb1"}]}} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:41:44.296308 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-91adef80-59b1-44e0-b78c-360fdac7ab4f tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:44.297165 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.network.neutron [None req-68913535-a6d6-427c-b43b-dd39856676be tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] validate_networks() for [('ef5319c3-a335-4216-bb12-ed5b7339edb1', None, None, None, None, None)] {{(pid=118117) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 16:41:44.307604 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-91adef80-59b1-44e0-b78c-360fdac7ab4f tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:44.309438 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-91adef80-59b1-44e0-b78c-360fdac7ab4f tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:44.310837 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-91adef80-59b1-44e0-b78c-360fdac7ab4f tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1740 microversion: 2.20 time: 0.491194 Aug 01 16:41:44.328084 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 188/368] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:41:43 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1740 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:41:44.418464 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-874bdcd8-196e-496d-831a-c8c074fb5d71 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:44.419566 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-874bdcd8-196e-496d-831a-c8c074fb5d71 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: ddf9be16-b3ce-411b-ac14-17dae5f41821] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:44.427834 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-874bdcd8-196e-496d-831a-c8c074fb5d71 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:44.428713 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-874bdcd8-196e-496d-831a-c8c074fb5d71 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:44.429812 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-874bdcd8-196e-496d-831a-c8c074fb5d71 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:44.430352 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-874bdcd8-196e-496d-831a-c8c074fb5d71 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:44.681712 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-874bdcd8-196e-496d-831a-c8c074fb5d71 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:44.692456 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-874bdcd8-196e-496d-831a-c8c074fb5d71 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/ddf9be16-b3ce-411b-ac14-17dae5f41821" status: 200 len: 1521 microversion: 2.1 time: 0.278608 Aug 01 16:41:44.693730 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 189/369] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:44 2022] GET /compute/v2.1/servers/ddf9be16-b3ce-411b-ac14-17dae5f41821 => generated 1521 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:44.849557 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [req-90ff81b7-074e-4956-a20c-720b704295ae req-ed14daa4-b988-48a4-9519-0dbacb81fe81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "879465e3-1ea1-4193-aa67-f1648076f9c2", "name": "network-vif-deleted", "tag": "90beeb8e-5d34-4a76-bb5b-966b9ac81523"}, {"name": "network-changed", "server_uuid": "53e1f340-623b-4453-8735-db4701fef4ad", "tag": "d2ccad51-ab9b-4f8e-8230-cba7cac23a82"}]} {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:41:44.872345 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-90ff81b7-074e-4956-a20c-720b704295ae req-ed14daa4-b988-48a4-9519-0dbacb81fe81 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:44.872797 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-90ff81b7-074e-4956-a20c-720b704295ae req-ed14daa4-b988-48a4-9519-0dbacb81fe81 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:44.896670 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.compute.server_external_events [req-90ff81b7-074e-4956-a20c-720b704295ae req-ed14daa4-b988-48a4-9519-0dbacb81fe81 service nova] Creating event network-vif-deleted:90beeb8e-5d34-4a76-bb5b-966b9ac81523 for instance 879465e3-1ea1-4193-aa67-f1648076f9c2 on hv-cinder-85032 Aug 01 16:41:44.897681 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.compute.server_external_events [req-90ff81b7-074e-4956-a20c-720b704295ae req-ed14daa4-b988-48a4-9519-0dbacb81fe81 service nova] Creating event network-changed:d2ccad51-ab9b-4f8e-8230-cba7cac23a82 for instance 53e1f340-623b-4453-8735-db4701fef4ad on hv-cinder-85032 Aug 01 16:41:44.907692 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [req-90ff81b7-074e-4956-a20c-720b704295ae req-ed14daa4-b988-48a4-9519-0dbacb81fe81 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.066120 Aug 01 16:41:44.909410 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 190/370] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:41:44 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:41:45.012954 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.virt.hardware [None req-68913535-a6d6-427c-b43b-dd39856676be tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Flavor limits 0:0:0 {{(pid=118117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 16:41:45.015088 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.virt.hardware [None req-68913535-a6d6-427c-b43b-dd39856676be tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Image limits 0:0:0 {{(pid=118117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 16:41:45.016712 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.virt.hardware [None req-68913535-a6d6-427c-b43b-dd39856676be tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Flavor pref 0:0:0 {{(pid=118117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 16:41:45.018080 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.virt.hardware [None req-68913535-a6d6-427c-b43b-dd39856676be tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Image pref 0:0:0 {{(pid=118117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 16:41:45.019302 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.virt.hardware [None req-68913535-a6d6-427c-b43b-dd39856676be tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 16:41:45.023830 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-9d0d3502-b09a-45c5-abe5-a078ad29b4f9 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:45.024909 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-9d0d3502-b09a-45c5-abe5-a078ad29b4f9 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 53e1f340-623b-4453-8735-db4701fef4ad] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:45.035032 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-9d0d3502-b09a-45c5-abe5-a078ad29b4f9 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:45.036692 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-9d0d3502-b09a-45c5-abe5-a078ad29b4f9 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:45.037844 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-9d0d3502-b09a-45c5-abe5-a078ad29b4f9 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:45.038586 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-9d0d3502-b09a-45c5-abe5-a078ad29b4f9 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:45.050293 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-68913535-a6d6-427c-b43b-dd39856676be tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:45.051573 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-68913535-a6d6-427c-b43b-dd39856676be tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:45.053777 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-68913535-a6d6-427c-b43b-dd39856676be tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:45.054798 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-68913535-a6d6-427c-b43b-dd39856676be tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:45.088835 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.quota [None req-68913535-a6d6-427c-b43b-dd39856676be tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Getting quotas for project d08c78acd1db446bac4352f66e792085. Resources: {'cores', 'ram', 'instances'} {{(pid=118117) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 16:41:45.094069 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.quota [None req-68913535-a6d6-427c-b43b-dd39856676be tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Getting quotas for user c6a8231119f34ef98b8a85303c5c447e and project d08c78acd1db446bac4352f66e792085. Resources: {'cores', 'ram', 'instances'} {{(pid=118117) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 16:41:45.113703 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:41:45.128498 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-68913535-a6d6-427c-b43b-dd39856676be tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Going to run 1 instances... {{(pid=118117) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 16:41:45.133104 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-68913535-a6d6-427c-b43b-dd39856676be tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] [instance: dbaee35c-998a-40a8-ba66-c13974b81cae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c9cb5329-85cb-4472-935d-c4ea1d1f0592',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118117) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 16:41:45.212224 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-68913535-a6d6-427c-b43b-dd39856676be tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.994755 Aug 01 16:41:45.213471 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 181/371] 10.222.0.45 () {60 vars in 1147 bytes} [Mon Aug 1 16:41:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 997 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 01 16:41:45.228068 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-272f2420-7b2a-4cd6-b7f0-7a66788f5462 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:45.229188 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-272f2420-7b2a-4cd6-b7f0-7a66788f5462 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] [instance: dbaee35c-998a-40a8-ba66-c13974b81cae] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:45.268011 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-9d0d3502-b09a-45c5-abe5-a078ad29b4f9 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac7d3acf1204a9f98f9ee14c2b46a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f46e472f8614c5e847ceb225cc9bff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:45.286944 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-9d0d3502-b09a-45c5-abe5-a078ad29b4f9 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/53e1f340-623b-4453-8735-db4701fef4ad" status: 200 len: 1366 microversion: 2.1 time: 0.268271 Aug 01 16:41:45.304406 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 191/372] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:45 2022] GET /compute/v2.1/servers/53e1f340-623b-4453-8735-db4701fef4ad => generated 1366 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:45.339247 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-53d0d395-7a02-44b7-948d-af0aa3f597a3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:45.340566 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-272f2420-7b2a-4cd6-b7f0-7a66788f5462 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a8231119f34ef98b8a85303c5c447e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08c78acd1db446bac4352f66e792085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:45.346927 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-53d0d395-7a02-44b7-948d-af0aa3f597a3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:45.356734 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-272f2420-7b2a-4cd6-b7f0-7a66788f5462 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] 10.222.0.45 "GET /compute/v2.1/servers/dbaee35c-998a-40a8-ba66-c13974b81cae" status: 200 len: 1214 microversion: 2.1 time: 0.134714 Aug 01 16:41:45.357687 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 182/373] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:45 2022] GET /compute/v2.1/servers/dbaee35c-998a-40a8-ba66-c13974b81cae => generated 1214 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:45.376281 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-53d0d395-7a02-44b7-948d-af0aa3f597a3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:45.377077 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-53d0d395-7a02-44b7-948d-af0aa3f597a3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:45.378203 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-53d0d395-7a02-44b7-948d-af0aa3f597a3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:45.378906 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-53d0d395-7a02-44b7-948d-af0aa3f597a3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:45.713930 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-f236b347-c600-4162-85af-5035bd1b3528 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:45.715519 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-f236b347-c600-4162-85af-5035bd1b3528 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: ddf9be16-b3ce-411b-ac14-17dae5f41821] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:45.733546 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-f236b347-c600-4162-85af-5035bd1b3528 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:45.736306 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-f236b347-c600-4162-85af-5035bd1b3528 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:45.738467 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-f236b347-c600-4162-85af-5035bd1b3528 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:45.738927 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-f236b347-c600-4162-85af-5035bd1b3528 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:45.872380 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-53d0d395-7a02-44b7-948d-af0aa3f597a3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:45.887149 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-53d0d395-7a02-44b7-948d-af0aa3f597a3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:45.892358 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-53d0d395-7a02-44b7-948d-af0aa3f597a3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:45.899286 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-53d0d395-7a02-44b7-948d-af0aa3f597a3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1740 microversion: 2.20 time: 0.568372 Aug 01 16:41:45.904580 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 192/374] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:41:45 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1740 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:41:46.130305 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-f236b347-c600-4162-85af-5035bd1b3528 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:46.153174 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-f236b347-c600-4162-85af-5035bd1b3528 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/ddf9be16-b3ce-411b-ac14-17dae5f41821" status: 200 len: 1521 microversion: 2.1 time: 0.442291 Aug 01 16:41:46.154708 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 183/375] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:45 2022] GET /compute/v2.1/servers/ddf9be16-b3ce-411b-ac14-17dae5f41821 => generated 1521 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:41:46.315740 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-98c7d14d-fc00-4b36-80f2-8701faef4866 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:46.317248 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-98c7d14d-fc00-4b36-80f2-8701faef4866 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 53e1f340-623b-4453-8735-db4701fef4ad] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:46.330004 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-98c7d14d-fc00-4b36-80f2-8701faef4866 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:46.330503 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-98c7d14d-fc00-4b36-80f2-8701faef4866 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:46.331228 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-98c7d14d-fc00-4b36-80f2-8701faef4866 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:46.331648 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-98c7d14d-fc00-4b36-80f2-8701faef4866 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:46.381180 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-7c8021d3-67c4-4c77-bba3-d80424783247 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:46.381180 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-7c8021d3-67c4-4c77-bba3-d80424783247 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] [instance: dbaee35c-998a-40a8-ba66-c13974b81cae] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:46.388230 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-7c8021d3-67c4-4c77-bba3-d80424783247 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:46.388957 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-7c8021d3-67c4-4c77-bba3-d80424783247 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:46.389885 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-7c8021d3-67c4-4c77-bba3-d80424783247 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:46.390515 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-7c8021d3-67c4-4c77-bba3-d80424783247 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:46.515812 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-7c8021d3-67c4-4c77-bba3-d80424783247 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a8231119f34ef98b8a85303c5c447e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08c78acd1db446bac4352f66e792085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:46.537957 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-7c8021d3-67c4-4c77-bba3-d80424783247 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] 10.222.0.45 "GET /compute/v2.1/servers/dbaee35c-998a-40a8-ba66-c13974b81cae" status: 200 len: 1218 microversion: 2.1 time: 0.162335 Aug 01 16:41:46.546838 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 184/376] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:46 2022] GET /compute/v2.1/servers/dbaee35c-998a-40a8-ba66-c13974b81cae => generated 1218 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:46.632941 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-98c7d14d-fc00-4b36-80f2-8701faef4866 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac7d3acf1204a9f98f9ee14c2b46a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f46e472f8614c5e847ceb225cc9bff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:46.635990 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_cell1:SELECT=100 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:41:46.644896 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-98c7d14d-fc00-4b36-80f2-8701faef4866 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/53e1f340-623b-4453-8735-db4701fef4ad" status: 200 len: 1366 microversion: 2.1 time: 0.335268 Aug 01 16:41:46.645950 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 193/377] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:46 2022] GET /compute/v2.1/servers/53e1f340-623b-4453-8735-db4701fef4ad => generated 1366 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:41:46.930492 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-7c750c0a-9153-4eb1-9827-1970703e64a1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:46.931103 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-7c750c0a-9153-4eb1-9827-1970703e64a1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:46.941453 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-7c750c0a-9153-4eb1-9827-1970703e64a1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:46.941896 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-7c750c0a-9153-4eb1-9827-1970703e64a1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:46.942666 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-7c750c0a-9153-4eb1-9827-1970703e64a1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:46.943095 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-7c750c0a-9153-4eb1-9827-1970703e64a1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:47.179341 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-a499baee-9c4e-4aec-bc57-6d1380f25e1a tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:47.181179 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-a499baee-9c4e-4aec-bc57-6d1380f25e1a tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: ddf9be16-b3ce-411b-ac14-17dae5f41821] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:47.196340 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a499baee-9c4e-4aec-bc57-6d1380f25e1a tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:47.197189 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a499baee-9c4e-4aec-bc57-6d1380f25e1a tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:47.198184 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a499baee-9c4e-4aec-bc57-6d1380f25e1a tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:47.200490 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a499baee-9c4e-4aec-bc57-6d1380f25e1a tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:47.501180 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-7c750c0a-9153-4eb1-9827-1970703e64a1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:47.512974 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-7c750c0a-9153-4eb1-9827-1970703e64a1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:47.519507 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-7c750c0a-9153-4eb1-9827-1970703e64a1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:47.525684 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-7c750c0a-9153-4eb1-9827-1970703e64a1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1740 microversion: 2.20 time: 0.601118 Aug 01 16:41:47.526509 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 185/378] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:41:46 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1740 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:41:47.566507 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-d535424c-fd79-47ab-b228-285c72aff01e tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:47.568904 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-d535424c-fd79-47ab-b228-285c72aff01e tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] [instance: dbaee35c-998a-40a8-ba66-c13974b81cae] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:47.581395 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-d535424c-fd79-47ab-b228-285c72aff01e tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:47.582252 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-d535424c-fd79-47ab-b228-285c72aff01e tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:47.583456 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-d535424c-fd79-47ab-b228-285c72aff01e tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:47.584671 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-d535424c-fd79-47ab-b228-285c72aff01e tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:47.651407 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-a499baee-9c4e-4aec-bc57-6d1380f25e1a tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:47.661665 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-a499baee-9c4e-4aec-bc57-6d1380f25e1a tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/ddf9be16-b3ce-411b-ac14-17dae5f41821" status: 200 len: 1521 microversion: 2.1 time: 0.486733 Aug 01 16:41:47.662252 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 194/379] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:47 2022] GET /compute/v2.1/servers/ddf9be16-b3ce-411b-ac14-17dae5f41821 => generated 1521 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:41:47.693704 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-63dd4bba-4773-4903-975c-31ffb45158a2 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:47.694585 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-63dd4bba-4773-4903-975c-31ffb45158a2 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 53e1f340-623b-4453-8735-db4701fef4ad] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:47.719840 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-63dd4bba-4773-4903-975c-31ffb45158a2 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:47.721681 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-63dd4bba-4773-4903-975c-31ffb45158a2 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:47.722750 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-63dd4bba-4773-4903-975c-31ffb45158a2 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:47.723675 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-63dd4bba-4773-4903-975c-31ffb45158a2 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:48.094228 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-d535424c-fd79-47ab-b228-285c72aff01e tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a8231119f34ef98b8a85303c5c447e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08c78acd1db446bac4352f66e792085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:48.102891 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-d535424c-fd79-47ab-b228-285c72aff01e tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] 10.222.0.45 "GET /compute/v2.1/servers/dbaee35c-998a-40a8-ba66-c13974b81cae" status: 200 len: 1266 microversion: 2.1 time: 0.543181 Aug 01 16:41:48.119928 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 186/380] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:47 2022] GET /compute/v2.1/servers/dbaee35c-998a-40a8-ba66-c13974b81cae => generated 1266 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:41:48.302833 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-63dd4bba-4773-4903-975c-31ffb45158a2 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac7d3acf1204a9f98f9ee14c2b46a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f46e472f8614c5e847ceb225cc9bff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:48.316886 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-63dd4bba-4773-4903-975c-31ffb45158a2 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/53e1f340-623b-4453-8735-db4701fef4ad" status: 200 len: 1366 microversion: 2.1 time: 0.631296 Aug 01 16:41:48.319494 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 195/381] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:47 2022] GET /compute/v2.1/servers/53e1f340-623b-4453-8735-db4701fef4ad => generated 1366 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:41:48.558785 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-212a3253-a3cb-4d3e-b52c-fb564304d0d1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:48.560349 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-212a3253-a3cb-4d3e-b52c-fb564304d0d1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:48.569779 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-212a3253-a3cb-4d3e-b52c-fb564304d0d1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:48.570642 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-212a3253-a3cb-4d3e-b52c-fb564304d0d1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:48.574175 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-212a3253-a3cb-4d3e-b52c-fb564304d0d1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:48.574943 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-212a3253-a3cb-4d3e-b52c-fb564304d0d1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:48.689598 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-4ba512e1-080f-4592-aacf-2c9d56d8710f tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:48.690226 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-4ba512e1-080f-4592-aacf-2c9d56d8710f tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: ddf9be16-b3ce-411b-ac14-17dae5f41821] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:48.700070 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-4ba512e1-080f-4592-aacf-2c9d56d8710f tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:48.700778 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-4ba512e1-080f-4592-aacf-2c9d56d8710f tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:48.701725 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-4ba512e1-080f-4592-aacf-2c9d56d8710f tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:48.702721 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-4ba512e1-080f-4592-aacf-2c9d56d8710f tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:48.931477 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-212a3253-a3cb-4d3e-b52c-fb564304d0d1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:48.960636 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-212a3253-a3cb-4d3e-b52c-fb564304d0d1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:48.962422 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-212a3253-a3cb-4d3e-b52c-fb564304d0d1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:48.963929 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-212a3253-a3cb-4d3e-b52c-fb564304d0d1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1740 microversion: 2.20 time: 0.409906 Aug 01 16:41:48.991370 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 187/382] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:41:48 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1740 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:41:49.030257 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-4ba512e1-080f-4592-aacf-2c9d56d8710f tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:49.052990 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-4ba512e1-080f-4592-aacf-2c9d56d8710f tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/ddf9be16-b3ce-411b-ac14-17dae5f41821" status: 200 len: 1521 microversion: 2.1 time: 0.368138 Aug 01 16:41:49.054469 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 196/383] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:48 2022] GET /compute/v2.1/servers/ddf9be16-b3ce-411b-ac14-17dae5f41821 => generated 1521 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:49.136039 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-05f82413-2785-45fc-a058-94a35ff45a14 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:49.136039 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-05f82413-2785-45fc-a058-94a35ff45a14 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] [instance: dbaee35c-998a-40a8-ba66-c13974b81cae] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:49.141030 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-05f82413-2785-45fc-a058-94a35ff45a14 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:49.141461 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-05f82413-2785-45fc-a058-94a35ff45a14 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:49.142557 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-05f82413-2785-45fc-a058-94a35ff45a14 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:49.143137 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-05f82413-2785-45fc-a058-94a35ff45a14 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:49.229651 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-05f82413-2785-45fc-a058-94a35ff45a14 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a8231119f34ef98b8a85303c5c447e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08c78acd1db446bac4352f66e792085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:49.244241 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-05f82413-2785-45fc-a058-94a35ff45a14 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] 10.222.0.45 "GET /compute/v2.1/servers/dbaee35c-998a-40a8-ba66-c13974b81cae" status: 200 len: 1272 microversion: 2.1 time: 0.121017 Aug 01 16:41:49.245389 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 188/384] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:49 2022] GET /compute/v2.1/servers/dbaee35c-998a-40a8-ba66-c13974b81cae => generated 1272 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:49.342362 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-146317d6-3135-4878-8cfb-fa7faab59436 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:49.343018 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-146317d6-3135-4878-8cfb-fa7faab59436 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 53e1f340-623b-4453-8735-db4701fef4ad] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:49.370019 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-146317d6-3135-4878-8cfb-fa7faab59436 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:49.373225 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-146317d6-3135-4878-8cfb-fa7faab59436 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:49.376506 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-146317d6-3135-4878-8cfb-fa7faab59436 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:49.376671 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-146317d6-3135-4878-8cfb-fa7faab59436 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:49.619832 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [req-6d33fae7-5544-4cbe-9031-fdb22e5bc942 req-24fdd317-680d-4d85-90e3-b86f63914e61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53e1f340-623b-4453-8735-db4701fef4ad", "name": "network-vif-plugged", "status": "completed", "tag": "d2ccad51-ab9b-4f8e-8230-cba7cac23a82"}]} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:41:49.643640 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-6d33fae7-5544-4cbe-9031-fdb22e5bc942 req-24fdd317-680d-4d85-90e3-b86f63914e61 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:49.644226 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-6d33fae7-5544-4cbe-9031-fdb22e5bc942 req-24fdd317-680d-4d85-90e3-b86f63914e61 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:49.696681 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.compute.server_external_events [req-6d33fae7-5544-4cbe-9031-fdb22e5bc942 req-24fdd317-680d-4d85-90e3-b86f63914e61 service nova] Creating event network-vif-plugged:d2ccad51-ab9b-4f8e-8230-cba7cac23a82 for instance 53e1f340-623b-4453-8735-db4701fef4ad on hv-cinder-85032 Aug 01 16:41:49.709225 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [req-6d33fae7-5544-4cbe-9031-fdb22e5bc942 req-24fdd317-680d-4d85-90e3-b86f63914e61 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092849 Aug 01 16:41:49.709855 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 189/385] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:41:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:41:49.882229 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-146317d6-3135-4878-8cfb-fa7faab59436 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac7d3acf1204a9f98f9ee14c2b46a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f46e472f8614c5e847ceb225cc9bff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:49.891184 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-146317d6-3135-4878-8cfb-fa7faab59436 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/53e1f340-623b-4453-8735-db4701fef4ad" status: 200 len: 1366 microversion: 2.1 time: 0.552834 Aug 01 16:41:49.891787 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 197/386] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:49 2022] GET /compute/v2.1/servers/53e1f340-623b-4453-8735-db4701fef4ad => generated 1366 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:50.003521 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-e83b45fa-20c9-41c7-94b4-2317a27fbaa9 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:50.004405 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-e83b45fa-20c9-41c7-94b4-2317a27fbaa9 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:50.018443 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-e83b45fa-20c9-41c7-94b4-2317a27fbaa9 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:50.028412 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-e83b45fa-20c9-41c7-94b4-2317a27fbaa9 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:50.029298 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-e83b45fa-20c9-41c7-94b4-2317a27fbaa9 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:50.029771 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-e83b45fa-20c9-41c7-94b4-2317a27fbaa9 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:50.076138 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-7ae64717-ecee-4402-af7d-92e53be48c70 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:50.076662 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-7ae64717-ecee-4402-af7d-92e53be48c70 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: ddf9be16-b3ce-411b-ac14-17dae5f41821] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:50.081399 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_cell1:SELECT=100 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:41:50.092266 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-7ae64717-ecee-4402-af7d-92e53be48c70 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:50.093196 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-7ae64717-ecee-4402-af7d-92e53be48c70 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:50.097195 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-7ae64717-ecee-4402-af7d-92e53be48c70 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:50.100009 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-7ae64717-ecee-4402-af7d-92e53be48c70 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:50.545780 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-e83b45fa-20c9-41c7-94b4-2317a27fbaa9 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:50.566178 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-e83b45fa-20c9-41c7-94b4-2317a27fbaa9 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:50.566905 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-7ae64717-ecee-4402-af7d-92e53be48c70 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:50.568892 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-e83b45fa-20c9-41c7-94b4-2317a27fbaa9 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:50.570375 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-e83b45fa-20c9-41c7-94b4-2317a27fbaa9 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1740 microversion: 2.20 time: 0.571122 Aug 01 16:41:50.577636 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-7ae64717-ecee-4402-af7d-92e53be48c70 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/ddf9be16-b3ce-411b-ac14-17dae5f41821" status: 200 len: 1501 microversion: 2.1 time: 0.505718 Aug 01 16:41:50.579046 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 198/387] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:50 2022] GET /compute/v2.1/servers/ddf9be16-b3ce-411b-ac14-17dae5f41821 => generated 1501 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:41:50.587346 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 190/388] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:41:49 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1740 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:41:50.592142 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-426e0357-9ee0-4b40-9e5c-43cdb73ffe53 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:50.595292 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-426e0357-9ee0-4b40-9e5c-43cdb73ffe53 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] [instance: dbaee35c-998a-40a8-ba66-c13974b81cae] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:50.604682 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-80ca9aaa-d6d3-4e1c-8251-5f167034ab73 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6e26382b-d49c-4aeb-b20a-9a246ba10087"}} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:41:50.607122 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-80ca9aaa-d6d3-4e1c-8251-5f167034ab73 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: ddf9be16-b3ce-411b-ac14-17dae5f41821] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:50.613764 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-80ca9aaa-d6d3-4e1c-8251-5f167034ab73 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:50.614196 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-80ca9aaa-d6d3-4e1c-8251-5f167034ab73 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:50.615207 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-80ca9aaa-d6d3-4e1c-8251-5f167034ab73 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:50.615802 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-80ca9aaa-d6d3-4e1c-8251-5f167034ab73 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:50.618896 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-426e0357-9ee0-4b40-9e5c-43cdb73ffe53 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:50.619888 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-426e0357-9ee0-4b40-9e5c-43cdb73ffe53 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:50.624212 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-426e0357-9ee0-4b40-9e5c-43cdb73ffe53 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:50.625449 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-426e0357-9ee0-4b40-9e5c-43cdb73ffe53 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:50.649399 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.wsgi [None req-80ca9aaa-d6d3-4e1c-8251-5f167034ab73 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] HTTP exception thrown: Cannot 'attach_volume' instance ddf9be16-b3ce-411b-ac14-17dae5f41821 while it is in vm_state rescued Aug 01 16:41:50.652168 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-80ca9aaa-d6d3-4e1c-8251-5f167034ab73 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Request method failure captured: Aug 01 16:41:50.652168 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: request: POST /compute/v2.1/servers/ddf9be16-b3ce-411b-ac14-17dae5f41821/os-volume_attachments HTTP/1.1 Aug 01 16:41:50.652168 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Accept: application/json Aug 01 16:41:50.652168 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Accept-Encoding: identity Aug 01 16:41:50.652168 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Connection: close Aug 01 16:41:50.652168 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Content-Length: 74 Aug 01 16:41:50.652168 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Content-Type: application/json Aug 01 16:41:50.652168 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Host: 10.222.0.45 Aug 01 16:41:50.652168 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Openstack-System-Scope: None Aug 01 16:41:50.652168 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: User-Agent: python-urllib3/1.26.10 Aug 01 16:41:50.652168 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Auth-Token: gAAAAABi6AHBHBBMxUjuAe-cwnK815X7ZxuzFHyHjtrk1uJot40PNHiBi2X9YMJeHWohQLbZQ5KLL_REXas2dwpv6zW97hCtQR9_HhjsDDAU83KRBYwvEJCNPLIcHZ71AIrAo_sj1b009gKLC_UwiqB_GoFhYRdPglged0gU-Y7E301TTJaBV1M Aug 01 16:41:50.652168 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Domain-Id: None Aug 01 16:41:50.652168 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Domain-Name: None Aug 01 16:41:50.652168 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Identity-Status: Confirmed Aug 01 16:41:50.652168 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Is-Admin-Project: True Aug 01 16:41:50.652168 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Domain-Id: default Aug 01 16:41:50.652168 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Domain-Name: Default Aug 01 16:41:50.652168 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Id: dbd6814591334db58a37092eb04729fb Aug 01 16:41:50.652168 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1899232052 Aug 01 16:41:50.652168 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Role: reader,member Aug 01 16:41:50.652168 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Roles: reader,member Aug 01 16:41:50.654652 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_dbd6814591334db58a37092eb04729fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/dbd6814591334db58a37092eb04729fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/dbd6814591334db58a37092eb04729fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/dbd6814591334db58a37092eb04729fb"}]}] Aug 01 16:41:50.654652 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1899232052 Aug 01 16:41:50.654652 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Tenant-Id: dbd6814591334db58a37092eb04729fb Aug 01 16:41:50.654652 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1899232052 Aug 01 16:41:50.654652 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User: tempest-ServerRescueNegativeTestJSON-1899232052-project Aug 01 16:41:50.654652 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Domain-Id: default Aug 01 16:41:50.654652 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Domain-Name: Default Aug 01 16:41:50.654652 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Id: 4294d6dff5054da7afcb37b8b28f1a01 Aug 01 16:41:50.654652 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1899232052-project Aug 01 16:41:50.654652 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Aug 01 16:41:50.654652 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: {"volumeAttachment": {"volumeId": "6e26382b-d49c-4aeb-b20a-9a246ba10087"}} Aug 01 16:41:50.654652 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: method: > Aug 01 16:41:50.657059 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: exception: Cannot 'attach_volume' instance ddf9be16-b3ce-411b-ac14-17dae5f41821 while it is in vm_state rescued Aug 01 16:41:50.657059 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: action_args: {'server_id': 'ddf9be16-b3ce-411b-ac14-17dae5f41821', 'body': {'volumeAttachment': {'volumeId': '6e26382b-d49c-4aeb-b20a-9a246ba10087'}}} Aug 01 16:41:50.657059 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:41:50.657059 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:41:50.657059 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 01 16:41:50.657059 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 01 16:41:50.657059 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 01 16:41:50.657059 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 01 16:41:50.657059 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 01 16:41:50.657059 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 01 16:41:50.657059 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ddf9be16-b3ce-411b-ac14-17dae5f41821 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 01 16:41:50.657059 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:41:50.657059 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:41:50.657059 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:41:50.657059 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:41:50.657059 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:41:50.657059 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:41:50.657059 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:41:50.657059 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:41:50.662044 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:41:50.662044 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:41:50.662044 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 16:41:50.662044 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 16:41:50.662044 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 16:41:50.662044 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 16:41:50.662044 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 16:41:50.662044 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 16:41:50.662044 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 01 16:41:50.662044 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 01 16:41:50.662044 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 01 16:41:50.662044 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 01 16:41:50.662044 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance ddf9be16-b3ce-411b-ac14-17dae5f41821 while it is in vm_state rescued Aug 01 16:41:50.662044 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:41:50.662044 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:41:50.662044 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:41:50.662044 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:41:50.662044 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:41:50.662044 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:41:50.667343 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:41:50.667343 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:41:50.667343 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance ddf9be16-b3ce-411b-ac14-17dae5f41821 while it is in vm_state rescued Aug 01 16:41:50.667343 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:41:50.667343 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-80ca9aaa-d6d3-4e1c-8251-5f167034ab73 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Returning 409 to user: Cannot 'attach_volume' instance ddf9be16-b3ce-411b-ac14-17dae5f41821 while it is in vm_state rescued {{(pid=118117) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:41:50.667343 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-80ca9aaa-d6d3-4e1c-8251-5f167034ab73 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "POST /compute/v2.1/servers/ddf9be16-b3ce-411b-ac14-17dae5f41821/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.054873 Aug 01 16:41:50.667343 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 191/389] 10.222.0.45 () {60 vars in 1323 bytes} [Mon Aug 1 16:41:50 2022] POST /compute/v2.1/servers/ddf9be16-b3ce-411b-ac14-17dae5f41821/os-volume_attachments => generated 152 bytes in 57 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 01 16:41:50.667343 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-605ffc7e-80df-4cb7-882b-411868c272b6 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:41:50.668452 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-605ffc7e-80df-4cb7-882b-411868c272b6 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: ddf9be16-b3ce-411b-ac14-17dae5f41821] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:50.683446 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-605ffc7e-80df-4cb7-882b-411868c272b6 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:50.688342 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-605ffc7e-80df-4cb7-882b-411868c272b6 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:50.688777 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-605ffc7e-80df-4cb7-882b-411868c272b6 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:50.689212 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-605ffc7e-80df-4cb7-882b-411868c272b6 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:50.744553 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-426e0357-9ee0-4b40-9e5c-43cdb73ffe53 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a8231119f34ef98b8a85303c5c447e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08c78acd1db446bac4352f66e792085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:50.753585 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-426e0357-9ee0-4b40-9e5c-43cdb73ffe53 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] 10.222.0.45 "GET /compute/v2.1/servers/dbaee35c-998a-40a8-ba66-c13974b81cae" status: 200 len: 1272 microversion: 2.1 time: 0.172577 Aug 01 16:41:50.758051 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 199/390] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:50 2022] GET /compute/v2.1/servers/dbaee35c-998a-40a8-ba66-c13974b81cae => generated 1272 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:50.808091 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-605ffc7e-80df-4cb7-882b-411868c272b6 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "POST /compute/v2.1/servers/ddf9be16-b3ce-411b-ac14-17dae5f41821/action" status: 202 len: 0 microversion: 2.1 time: 0.146948 Aug 01 16:41:50.813262 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 192/391] 10.222.0.45 () {60 vars in 1278 bytes} [Mon Aug 1 16:41:50 2022] POST /compute/v2.1/servers/ddf9be16-b3ce-411b-ac14-17dae5f41821/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 16:41:50.817696 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-89755c41-078c-46ad-ab41-1193aed5f76f tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:50.818481 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-89755c41-078c-46ad-ab41-1193aed5f76f tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: ddf9be16-b3ce-411b-ac14-17dae5f41821] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:50.825696 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-89755c41-078c-46ad-ab41-1193aed5f76f tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:50.826348 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-89755c41-078c-46ad-ab41-1193aed5f76f tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:50.828757 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-89755c41-078c-46ad-ab41-1193aed5f76f tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:50.829170 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-89755c41-078c-46ad-ab41-1193aed5f76f tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:50.916112 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-195fd1eb-57e2-48c0-875d-5c06b6622895 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:50.917419 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-195fd1eb-57e2-48c0-875d-5c06b6622895 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 53e1f340-623b-4453-8735-db4701fef4ad] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:50.928387 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-195fd1eb-57e2-48c0-875d-5c06b6622895 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:50.929142 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-195fd1eb-57e2-48c0-875d-5c06b6622895 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:50.930423 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-195fd1eb-57e2-48c0-875d-5c06b6622895 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:50.931242 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-195fd1eb-57e2-48c0-875d-5c06b6622895 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:51.051011 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-89755c41-078c-46ad-ab41-1193aed5f76f tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:51.062393 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-89755c41-078c-46ad-ab41-1193aed5f76f tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/ddf9be16-b3ce-411b-ac14-17dae5f41821" status: 200 len: 1509 microversion: 2.1 time: 0.248209 Aug 01 16:41:51.063617 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 200/392] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:50 2022] GET /compute/v2.1/servers/ddf9be16-b3ce-411b-ac14-17dae5f41821 => generated 1509 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:51.134786 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-195fd1eb-57e2-48c0-875d-5c06b6622895 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac7d3acf1204a9f98f9ee14c2b46a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f46e472f8614c5e847ceb225cc9bff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:51.155821 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-195fd1eb-57e2-48c0-875d-5c06b6622895 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/53e1f340-623b-4453-8735-db4701fef4ad" status: 200 len: 1366 microversion: 2.1 time: 0.245824 Aug 01 16:41:51.161382 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 193/393] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:50 2022] GET /compute/v2.1/servers/53e1f340-623b-4453-8735-db4701fef4ad => generated 1366 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:41:51.594166 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-75c73e38-a37e-4d88-a685-ec6370f4d4ec tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:51.594879 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-75c73e38-a37e-4d88-a685-ec6370f4d4ec tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:51.601979 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-75c73e38-a37e-4d88-a685-ec6370f4d4ec tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:51.602421 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-75c73e38-a37e-4d88-a685-ec6370f4d4ec tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:51.605164 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-75c73e38-a37e-4d88-a685-ec6370f4d4ec tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:51.606203 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-75c73e38-a37e-4d88-a685-ec6370f4d4ec tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:51.784708 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-3eea6736-5c8d-4212-9152-23b389bc66f3 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:51.785397 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-3eea6736-5c8d-4212-9152-23b389bc66f3 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] [instance: dbaee35c-998a-40a8-ba66-c13974b81cae] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:51.794032 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-3eea6736-5c8d-4212-9152-23b389bc66f3 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:51.796893 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-3eea6736-5c8d-4212-9152-23b389bc66f3 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:51.798220 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-3eea6736-5c8d-4212-9152-23b389bc66f3 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:51.800360 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-3eea6736-5c8d-4212-9152-23b389bc66f3 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:52.262524 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-75c73e38-a37e-4d88-a685-ec6370f4d4ec tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:52.277109 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-75c73e38-a37e-4d88-a685-ec6370f4d4ec tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:52.282778 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-75c73e38-a37e-4d88-a685-ec6370f4d4ec tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:52.286067 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-75c73e38-a37e-4d88-a685-ec6370f4d4ec tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1740 microversion: 2.20 time: 0.696194 Aug 01 16:41:52.287310 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 201/394] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:41:51 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1740 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:41:52.295564 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-3eea6736-5c8d-4212-9152-23b389bc66f3 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a8231119f34ef98b8a85303c5c447e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08c78acd1db446bac4352f66e792085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:52.309959 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-3eea6736-5c8d-4212-9152-23b389bc66f3 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] 10.222.0.45 "GET /compute/v2.1/servers/dbaee35c-998a-40a8-ba66-c13974b81cae" status: 200 len: 1314 microversion: 2.1 time: 0.530941 Aug 01 16:41:52.312501 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-2eac6a01-bc65-430a-9169-ccbef5ebaee8 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:52.313418 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 194/395] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:51 2022] GET /compute/v2.1/servers/dbaee35c-998a-40a8-ba66-c13974b81cae => generated 1314 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:52.317463 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-2eac6a01-bc65-430a-9169-ccbef5ebaee8 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: ddf9be16-b3ce-411b-ac14-17dae5f41821] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:52.322951 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-1af82ac4-60bc-4c1d-af29-ef5d35a98988 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:52.324725 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-1af82ac4-60bc-4c1d-af29-ef5d35a98988 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 53e1f340-623b-4453-8735-db4701fef4ad] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:52.332834 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-2eac6a01-bc65-430a-9169-ccbef5ebaee8 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:52.333508 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-2eac6a01-bc65-430a-9169-ccbef5ebaee8 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:52.336078 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-2eac6a01-bc65-430a-9169-ccbef5ebaee8 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:52.337955 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-2eac6a01-bc65-430a-9169-ccbef5ebaee8 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:52.345706 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-1af82ac4-60bc-4c1d-af29-ef5d35a98988 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:52.347431 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-1af82ac4-60bc-4c1d-af29-ef5d35a98988 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:52.350346 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-1af82ac4-60bc-4c1d-af29-ef5d35a98988 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:52.353120 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-1af82ac4-60bc-4c1d-af29-ef5d35a98988 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:52.822134 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-2eac6a01-bc65-430a-9169-ccbef5ebaee8 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:52.846977 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-2eac6a01-bc65-430a-9169-ccbef5ebaee8 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/ddf9be16-b3ce-411b-ac14-17dae5f41821" status: 200 len: 1509 microversion: 2.1 time: 0.555794 Aug 01 16:41:52.848339 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 202/396] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:52 2022] GET /compute/v2.1/servers/ddf9be16-b3ce-411b-ac14-17dae5f41821 => generated 1509 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:52.871520 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-1af82ac4-60bc-4c1d-af29-ef5d35a98988 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac7d3acf1204a9f98f9ee14c2b46a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f46e472f8614c5e847ceb225cc9bff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:52.897911 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-1af82ac4-60bc-4c1d-af29-ef5d35a98988 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/53e1f340-623b-4453-8735-db4701fef4ad" status: 200 len: 1554 microversion: 2.1 time: 0.568307 Aug 01 16:41:52.897911 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 195/397] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:52 2022] GET /compute/v2.1/servers/53e1f340-623b-4453-8735-db4701fef4ad => generated 1554 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:52.921718 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-80d7dcd1-9460-4609-8e48-7686b0168a13 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:52.922195 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-80d7dcd1-9460-4609-8e48-7686b0168a13 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 53e1f340-623b-4453-8735-db4701fef4ad] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:52.942191 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-80d7dcd1-9460-4609-8e48-7686b0168a13 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:52.943302 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-80d7dcd1-9460-4609-8e48-7686b0168a13 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:52.944770 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-80d7dcd1-9460-4609-8e48-7686b0168a13 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:52.950759 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-80d7dcd1-9460-4609-8e48-7686b0168a13 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:53.050457 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [req-da0ae587-5a11-4a71-b856-0c520f5ba0a7 req-9c6d73df-0a50-496d-8a1c-83d2283169f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbaee35c-998a-40a8-ba66-c13974b81cae", "tag": "032bf1e8-9936-40fa-83f9-d6b7410b1d78"}]} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:41:53.077199 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-da0ae587-5a11-4a71-b856-0c520f5ba0a7 req-9c6d73df-0a50-496d-8a1c-83d2283169f7 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:53.077797 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-da0ae587-5a11-4a71-b856-0c520f5ba0a7 req-9c6d73df-0a50-496d-8a1c-83d2283169f7 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:53.111829 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.compute.server_external_events [req-da0ae587-5a11-4a71-b856-0c520f5ba0a7 req-9c6d73df-0a50-496d-8a1c-83d2283169f7 service nova] Creating event network-changed:032bf1e8-9936-40fa-83f9-d6b7410b1d78 for instance dbaee35c-998a-40a8-ba66-c13974b81cae on hv-cinder-85032 Aug 01 16:41:53.121573 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [req-da0ae587-5a11-4a71-b856-0c520f5ba0a7 req-9c6d73df-0a50-496d-8a1c-83d2283169f7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076014 Aug 01 16:41:53.122730 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 196/398] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:41:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 16:41:53.238122 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-80d7dcd1-9460-4609-8e48-7686b0168a13 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/53e1f340-623b-4453-8735-db4701fef4ad/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.319917 Aug 01 16:41:53.239429 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 203/399] 10.222.0.45 () {58 vars in 1275 bytes} [Mon Aug 1 16:41:52 2022] GET /compute/v2.1/servers/53e1f340-623b-4453-8735-db4701fef4ad/os-interface => generated 284 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:41:53.313121 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-1dfc8f6c-2c79-43e1-8f0d-da38fa9e0912 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:53.317089 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-1dfc8f6c-2c79-43e1-8f0d-da38fa9e0912 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:53.327139 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-1dfc8f6c-2c79-43e1-8f0d-da38fa9e0912 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:53.328309 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-1dfc8f6c-2c79-43e1-8f0d-da38fa9e0912 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:53.329313 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-1dfc8f6c-2c79-43e1-8f0d-da38fa9e0912 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:53.331830 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-1dfc8f6c-2c79-43e1-8f0d-da38fa9e0912 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:53.337279 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-c3604046-8926-47f0-b7f6-bed18bafeccb tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:53.338540 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-c3604046-8926-47f0-b7f6-bed18bafeccb tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] [instance: dbaee35c-998a-40a8-ba66-c13974b81cae] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:53.353722 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-c3604046-8926-47f0-b7f6-bed18bafeccb tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:53.354549 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-c3604046-8926-47f0-b7f6-bed18bafeccb tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:53.355463 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-c3604046-8926-47f0-b7f6-bed18bafeccb tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:53.356037 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-c3604046-8926-47f0-b7f6-bed18bafeccb tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:53.969649 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-c3604046-8926-47f0-b7f6-bed18bafeccb tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a8231119f34ef98b8a85303c5c447e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08c78acd1db446bac4352f66e792085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:53.982688 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-c3604046-8926-47f0-b7f6-bed18bafeccb tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] 10.222.0.45 "GET /compute/v2.1/servers/dbaee35c-998a-40a8-ba66-c13974b81cae" status: 200 len: 1314 microversion: 2.1 time: 0.647644 Aug 01 16:41:53.985760 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 204/400] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:53 2022] GET /compute/v2.1/servers/dbaee35c-998a-40a8-ba66-c13974b81cae => generated 1314 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:54.003014 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-3411cfd6-20bd-449e-b5b0-b8b5e06a5f59 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:54.003999 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-3411cfd6-20bd-449e-b5b0-b8b5e06a5f59 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: ddf9be16-b3ce-411b-ac14-17dae5f41821] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:54.012397 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3411cfd6-20bd-449e-b5b0-b8b5e06a5f59 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:54.015747 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3411cfd6-20bd-449e-b5b0-b8b5e06a5f59 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:54.016827 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3411cfd6-20bd-449e-b5b0-b8b5e06a5f59 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:54.018086 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3411cfd6-20bd-449e-b5b0-b8b5e06a5f59 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:54.027063 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-1dfc8f6c-2c79-43e1-8f0d-da38fa9e0912 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:54.043646 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-1dfc8f6c-2c79-43e1-8f0d-da38fa9e0912 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:54.045608 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-1dfc8f6c-2c79-43e1-8f0d-da38fa9e0912 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:54.047568 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-1dfc8f6c-2c79-43e1-8f0d-da38fa9e0912 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1740 microversion: 2.20 time: 0.738781 Aug 01 16:41:54.048644 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 197/401] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:41:53 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1740 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:41:54.218789 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-3411cfd6-20bd-449e-b5b0-b8b5e06a5f59 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:54.230117 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-3411cfd6-20bd-449e-b5b0-b8b5e06a5f59 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/ddf9be16-b3ce-411b-ac14-17dae5f41821" status: 200 len: 1509 microversion: 2.1 time: 0.243019 Aug 01 16:41:54.231174 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 205/402] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:53 2022] GET /compute/v2.1/servers/ddf9be16-b3ce-411b-ac14-17dae5f41821 => generated 1509 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:54.734347 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [req-47ace0f0-e811-4337-9ad9-5fb7551afd61 req-845f6d0f-0d2d-4637-a97f-aa76bd7516ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53e1f340-623b-4453-8735-db4701fef4ad", "tag": "d2ccad51-ab9b-4f8e-8230-cba7cac23a82"}]} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:41:54.745241 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-47ace0f0-e811-4337-9ad9-5fb7551afd61 req-845f6d0f-0d2d-4637-a97f-aa76bd7516ab service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:54.745693 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-47ace0f0-e811-4337-9ad9-5fb7551afd61 req-845f6d0f-0d2d-4637-a97f-aa76bd7516ab service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:54.757460 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.compute.server_external_events [req-47ace0f0-e811-4337-9ad9-5fb7551afd61 req-845f6d0f-0d2d-4637-a97f-aa76bd7516ab service nova] Creating event network-changed:d2ccad51-ab9b-4f8e-8230-cba7cac23a82 for instance 53e1f340-623b-4453-8735-db4701fef4ad on hv-cinder-85032 Aug 01 16:41:54.762313 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [req-47ace0f0-e811-4337-9ad9-5fb7551afd61 req-845f6d0f-0d2d-4637-a97f-aa76bd7516ab service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031794 Aug 01 16:41:54.762916 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 198/403] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:41:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:41:55.006372 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-1fdeeb4a-4fb8-4cf9-aa6f-c717096a3c93 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:55.007673 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-1fdeeb4a-4fb8-4cf9-aa6f-c717096a3c93 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] [instance: dbaee35c-998a-40a8-ba66-c13974b81cae] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:55.015436 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-1fdeeb4a-4fb8-4cf9-aa6f-c717096a3c93 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:55.016026 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-1fdeeb4a-4fb8-4cf9-aa6f-c717096a3c93 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:55.017013 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-1fdeeb4a-4fb8-4cf9-aa6f-c717096a3c93 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:55.017605 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-1fdeeb4a-4fb8-4cf9-aa6f-c717096a3c93 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:55.067900 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_cell0:SELECT=2 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:41:55.073844 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-7d51f882-1f52-4487-b223-ddaa3680564e tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:55.074703 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-7d51f882-1f52-4487-b223-ddaa3680564e tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:55.081688 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-7d51f882-1f52-4487-b223-ddaa3680564e tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:55.082126 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-7d51f882-1f52-4487-b223-ddaa3680564e tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:55.083089 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-7d51f882-1f52-4487-b223-ddaa3680564e tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:55.083515 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-7d51f882-1f52-4487-b223-ddaa3680564e tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:55.356791 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_cell0:SELECT=8 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:41:55.373029 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-1fdeeb4a-4fb8-4cf9-aa6f-c717096a3c93 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a8231119f34ef98b8a85303c5c447e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08c78acd1db446bac4352f66e792085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:55.382118 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-1fdeeb4a-4fb8-4cf9-aa6f-c717096a3c93 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] 10.222.0.45 "GET /compute/v2.1/servers/dbaee35c-998a-40a8-ba66-c13974b81cae" status: 200 len: 1314 microversion: 2.1 time: 0.380904 Aug 01 16:41:55.383113 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 206/404] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:54 2022] GET /compute/v2.1/servers/dbaee35c-998a-40a8-ba66-c13974b81cae => generated 1314 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:55.401500 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-74ceb31f-2df5-4917-8878-6018aefe7519 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:55.402521 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-74ceb31f-2df5-4917-8878-6018aefe7519 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: ddf9be16-b3ce-411b-ac14-17dae5f41821] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:55.409502 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-74ceb31f-2df5-4917-8878-6018aefe7519 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:55.410092 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-74ceb31f-2df5-4917-8878-6018aefe7519 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:55.410956 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-74ceb31f-2df5-4917-8878-6018aefe7519 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:55.411483 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-74ceb31f-2df5-4917-8878-6018aefe7519 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:55.414912 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-7d51f882-1f52-4487-b223-ddaa3680564e tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:55.428167 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-7d51f882-1f52-4487-b223-ddaa3680564e tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:55.430488 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-7d51f882-1f52-4487-b223-ddaa3680564e tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:55.431698 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-7d51f882-1f52-4487-b223-ddaa3680564e tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1740 microversion: 2.20 time: 0.364817 Aug 01 16:41:55.432672 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 199/405] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:41:55 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1740 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 16:41:55.579537 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-74ceb31f-2df5-4917-8878-6018aefe7519 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:55.587703 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-74ceb31f-2df5-4917-8878-6018aefe7519 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/ddf9be16-b3ce-411b-ac14-17dae5f41821" status: 200 len: 1509 microversion: 2.1 time: 0.196431 Aug 01 16:41:55.600006 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 207/406] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:55 2022] GET /compute/v2.1/servers/ddf9be16-b3ce-411b-ac14-17dae5f41821 => generated 1509 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:56.403950 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-41185d8f-0505-4ade-8715-8c92a6b06adc tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:56.404591 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-41185d8f-0505-4ade-8715-8c92a6b06adc tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] [instance: dbaee35c-998a-40a8-ba66-c13974b81cae] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:56.413855 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-41185d8f-0505-4ade-8715-8c92a6b06adc tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:56.414406 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-41185d8f-0505-4ade-8715-8c92a6b06adc tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:56.415346 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-41185d8f-0505-4ade-8715-8c92a6b06adc tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:56.415860 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-41185d8f-0505-4ade-8715-8c92a6b06adc tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:56.454980 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-8e2243a1-2fae-4af8-8cef-3e6d754ac3bf tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:56.455673 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-8e2243a1-2fae-4af8-8cef-3e6d754ac3bf tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:56.464554 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-8e2243a1-2fae-4af8-8cef-3e6d754ac3bf tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:56.465203 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-8e2243a1-2fae-4af8-8cef-3e6d754ac3bf tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:56.466149 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-8e2243a1-2fae-4af8-8cef-3e6d754ac3bf tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:56.466593 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-8e2243a1-2fae-4af8-8cef-3e6d754ac3bf tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:56.624816 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-41185d8f-0505-4ade-8715-8c92a6b06adc tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a8231119f34ef98b8a85303c5c447e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08c78acd1db446bac4352f66e792085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:56.632642 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-41185d8f-0505-4ade-8715-8c92a6b06adc tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] 10.222.0.45 "GET /compute/v2.1/servers/dbaee35c-998a-40a8-ba66-c13974b81cae" status: 200 len: 1314 microversion: 2.1 time: 0.232799 Aug 01 16:41:56.633219 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 200/407] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:56 2022] GET /compute/v2.1/servers/dbaee35c-998a-40a8-ba66-c13974b81cae => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:56.638046 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-3dcc1eb6-f5bc-4335-a047-563f6d07f8ce tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:56.638640 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-3dcc1eb6-f5bc-4335-a047-563f6d07f8ce tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: ddf9be16-b3ce-411b-ac14-17dae5f41821] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:56.645281 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-3dcc1eb6-f5bc-4335-a047-563f6d07f8ce tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:56.645676 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-3dcc1eb6-f5bc-4335-a047-563f6d07f8ce tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:56.646486 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-3dcc1eb6-f5bc-4335-a047-563f6d07f8ce tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:56.646910 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-3dcc1eb6-f5bc-4335-a047-563f6d07f8ce tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:56.654026 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-8e2243a1-2fae-4af8-8cef-3e6d754ac3bf tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:56.662712 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-8e2243a1-2fae-4af8-8cef-3e6d754ac3bf tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:56.664296 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-8e2243a1-2fae-4af8-8cef-3e6d754ac3bf tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:56.665517 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-8e2243a1-2fae-4af8-8cef-3e6d754ac3bf tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1722 microversion: 2.20 time: 0.214729 Aug 01 16:41:56.666049 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 208/408] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:41:56 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1722 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 16:41:56.782975 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-3dcc1eb6-f5bc-4335-a047-563f6d07f8ce tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:56.790634 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-3dcc1eb6-f5bc-4335-a047-563f6d07f8ce tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/ddf9be16-b3ce-411b-ac14-17dae5f41821" status: 200 len: 1515 microversion: 2.1 time: 0.156467 Aug 01 16:41:56.791194 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 201/409] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:56 2022] GET /compute/v2.1/servers/ddf9be16-b3ce-411b-ac14-17dae5f41821 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:57.653971 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-832c2778-dcd4-4368-9c00-0a79dcd8e69d tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:57.654570 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-832c2778-dcd4-4368-9c00-0a79dcd8e69d tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] [instance: dbaee35c-998a-40a8-ba66-c13974b81cae] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:57.660954 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-832c2778-dcd4-4368-9c00-0a79dcd8e69d tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:57.661396 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-832c2778-dcd4-4368-9c00-0a79dcd8e69d tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:57.662169 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-832c2778-dcd4-4368-9c00-0a79dcd8e69d tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:57.662599 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-832c2778-dcd4-4368-9c00-0a79dcd8e69d tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:57.690214 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-557b50af-c618-40d5-9dd6-ebdc520c2317 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:57.692917 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-557b50af-c618-40d5-9dd6-ebdc520c2317 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:57.700010 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-557b50af-c618-40d5-9dd6-ebdc520c2317 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:57.700460 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-557b50af-c618-40d5-9dd6-ebdc520c2317 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:57.701425 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-557b50af-c618-40d5-9dd6-ebdc520c2317 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:57.701854 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-557b50af-c618-40d5-9dd6-ebdc520c2317 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:58.129773 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-557b50af-c618-40d5-9dd6-ebdc520c2317 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:58.132837 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-832c2778-dcd4-4368-9c00-0a79dcd8e69d tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a8231119f34ef98b8a85303c5c447e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08c78acd1db446bac4352f66e792085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:58.140415 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-557b50af-c618-40d5-9dd6-ebdc520c2317 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:58.146336 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-832c2778-dcd4-4368-9c00-0a79dcd8e69d tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] 10.222.0.45 "GET /compute/v2.1/servers/dbaee35c-998a-40a8-ba66-c13974b81cae" status: 200 len: 1314 microversion: 2.1 time: 0.496044 Aug 01 16:41:58.148024 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 209/410] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:57 2022] GET /compute/v2.1/servers/dbaee35c-998a-40a8-ba66-c13974b81cae => generated 1314 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:58.150753 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-557b50af-c618-40d5-9dd6-ebdc520c2317 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:58.152132 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-557b50af-c618-40d5-9dd6-ebdc520c2317 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1722 microversion: 2.20 time: 0.466302 Aug 01 16:41:58.152815 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 202/411] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:41:57 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1722 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:41:58.214977 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-958a5abf-28af-4532-85aa-da07017d173f tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Action: 'create', calling method: .version_select at 0x7efd5ed4f4c0>, body: {"keypair": {"name": "tempest-keypair-1016633311", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGUkyjwLOP2czKrJJHjZfW45NR21DaLfVw3jX3CcQOA7+pL5jRa/JHPU6bnBZ15RbxsQISWw6h74/63Yq1+fQ4cLzvbTYmRxzsFiZjSac8e7gT4Kvqz7ETbnTqPwWjdeCw=="}} {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:41:58.238467 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.quota [None req-958a5abf-28af-4532-85aa-da07017d173f tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Getting quotas for project dbd6814591334db58a37092eb04729fb. Resources: {'key_pairs'} {{(pid=118118) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 16:41:58.241407 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_api:SELECT=100 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:41:58.243873 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.quota [None req-958a5abf-28af-4532-85aa-da07017d173f tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Getting quotas for user 4294d6dff5054da7afcb37b8b28f1a01 and project dbd6814591334db58a37092eb04729fb. Resources: {'key_pairs'} {{(pid=118118) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 16:41:58.288995 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-958a5abf-28af-4532-85aa-da07017d173f tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.077800 Aug 01 16:41:58.289891 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 210/412] 10.222.0.45 () {60 vars in 1159 bytes} [Mon Aug 1 16:41:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:41:59.177813 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-72e4f832-b205-42c0-96b4-26e9742b8a7f tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:59.178885 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-72e4f832-b205-42c0-96b4-26e9742b8a7f tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:59.182790 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-d7da7a6d-2abd-4932-aa78-0cce9f2bdeca tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:41:59.184962 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-d7da7a6d-2abd-4932-aa78-0cce9f2bdeca tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] [instance: dbaee35c-998a-40a8-ba66-c13974b81cae] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:41:59.186183 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-72e4f832-b205-42c0-96b4-26e9742b8a7f tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:59.188278 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-72e4f832-b205-42c0-96b4-26e9742b8a7f tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:59.188278 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-72e4f832-b205-42c0-96b4-26e9742b8a7f tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:59.188278 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-72e4f832-b205-42c0-96b4-26e9742b8a7f tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:59.198360 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-d7da7a6d-2abd-4932-aa78-0cce9f2bdeca tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:59.199016 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-d7da7a6d-2abd-4932-aa78-0cce9f2bdeca tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:59.200198 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-d7da7a6d-2abd-4932-aa78-0cce9f2bdeca tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:59.200761 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-d7da7a6d-2abd-4932-aa78-0cce9f2bdeca tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:59.507850 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-d7da7a6d-2abd-4932-aa78-0cce9f2bdeca tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a8231119f34ef98b8a85303c5c447e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08c78acd1db446bac4352f66e792085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:59.511857 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_cell1:SELECT=100 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:41:59.518645 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-d7da7a6d-2abd-4932-aa78-0cce9f2bdeca tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] 10.222.0.45 "GET /compute/v2.1/servers/dbaee35c-998a-40a8-ba66-c13974b81cae" status: 200 len: 1314 microversion: 2.1 time: 0.342493 Aug 01 16:41:59.520210 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 211/413] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:41:59 2022] GET /compute/v2.1/servers/dbaee35c-998a-40a8-ba66-c13974b81cae => generated 1314 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:41:59.528865 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-72e4f832-b205-42c0-96b4-26e9742b8a7f tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:59.541562 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-72e4f832-b205-42c0-96b4-26e9742b8a7f tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:59.544421 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-72e4f832-b205-42c0-96b4-26e9742b8a7f tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:41:59.546308 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-72e4f832-b205-42c0-96b4-26e9742b8a7f tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1722 microversion: 2.20 time: 0.373368 Aug 01 16:41:59.547375 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 203/414] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:41:59 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1722 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:41:59.698444 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [req-2487a3ca-eb37-4d12-ac9c-e74ca21a7ffc req-e374746f-6e5e-41c2-a58c-148193e79120 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1c8ed71-ea21-4bca-91bf-febe7457300e", "name": "network-vif-unplugged", "status": "completed", "tag": "734cefe8-e715-4af3-bebc-f135e61eb70c"}]} {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:41:59.723530 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-2487a3ca-eb37-4d12-ac9c-e74ca21a7ffc req-e374746f-6e5e-41c2-a58c-148193e79120 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:41:59.724690 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-2487a3ca-eb37-4d12-ac9c-e74ca21a7ffc req-e374746f-6e5e-41c2-a58c-148193e79120 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:41:59.746254 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.compute.server_external_events [req-2487a3ca-eb37-4d12-ac9c-e74ca21a7ffc req-e374746f-6e5e-41c2-a58c-148193e79120 service nova] Creating event network-vif-unplugged:734cefe8-e715-4af3-bebc-f135e61eb70c for instance f1c8ed71-ea21-4bca-91bf-febe7457300e on hv-cinder-85032 Aug 01 16:41:59.753219 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [req-2487a3ca-eb37-4d12-ac9c-e74ca21a7ffc req-e374746f-6e5e-41c2-a58c-148193e79120 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061701 Aug 01 16:41:59.754571 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 212/415] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:41:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:42:00.410117 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-d5ed63c8-9321-4cfd-b29d-580971bee8c7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-893795793", "imageRef": "c9cb5329-85cb-4472-935d-c4ea1d1f0592", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "60ce50c8-8e76-4dd8-a571-dff5507254cd"}], "security_groups": [{"name": "tempest-securitygroup--1734327998"}], "key_name": "tempest-keypair-1016633311", "user_data": "}} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:42:00.533230 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.network.neutron [None req-d5ed63c8-9321-4cfd-b29d-580971bee8c7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] validate_networks() for [('60ce50c8-8e76-4dd8-a571-dff5507254cd', None, None, None, None, None)] {{(pid=118117) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 16:42:00.542061 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-0ebb1a06-f555-462f-a4e3-0d31c6deaffd tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:00.543523 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-0ebb1a06-f555-462f-a4e3-0d31c6deaffd tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] [instance: dbaee35c-998a-40a8-ba66-c13974b81cae] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:00.552560 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-0ebb1a06-f555-462f-a4e3-0d31c6deaffd tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:00.553021 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-0ebb1a06-f555-462f-a4e3-0d31c6deaffd tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:00.554797 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-0ebb1a06-f555-462f-a4e3-0d31c6deaffd tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:00.555238 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-0ebb1a06-f555-462f-a4e3-0d31c6deaffd tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:01.133573 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-0ebb1a06-f555-462f-a4e3-0d31c6deaffd tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a8231119f34ef98b8a85303c5c447e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08c78acd1db446bac4352f66e792085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:01.141567 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-0ebb1a06-f555-462f-a4e3-0d31c6deaffd tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] 10.222.0.45 "GET /compute/v2.1/servers/dbaee35c-998a-40a8-ba66-c13974b81cae" status: 200 len: 1314 microversion: 2.1 time: 0.603965 Aug 01 16:42:01.142119 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 213/416] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:42:00 2022] GET /compute/v2.1/servers/dbaee35c-998a-40a8-ba66-c13974b81cae => generated 1314 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:42:01.154546 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-8e1c99a7-b0af-4ca5-ae84-d442825d72c6 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:01.155565 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-8e1c99a7-b0af-4ca5-ae84-d442825d72c6 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:01.162688 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-8e1c99a7-b0af-4ca5-ae84-d442825d72c6 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:01.163134 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-8e1c99a7-b0af-4ca5-ae84-d442825d72c6 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:01.164134 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-8e1c99a7-b0af-4ca5-ae84-d442825d72c6 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:01.164565 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-8e1c99a7-b0af-4ca5-ae84-d442825d72c6 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:01.482240 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-8e1c99a7-b0af-4ca5-ae84-d442825d72c6 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:01.493555 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-8e1c99a7-b0af-4ca5-ae84-d442825d72c6 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:01.496032 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-8e1c99a7-b0af-4ca5-ae84-d442825d72c6 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:01.498199 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-8e1c99a7-b0af-4ca5-ae84-d442825d72c6 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1665 microversion: 2.20 time: 0.347900 Aug 01 16:42:01.499449 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 214/417] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:42:01 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1665 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:42:01.521818 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-b6f14a6f-402f-49c4-9a25-ee6660fb8ef1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "21dad921-8887-46e2-b691-d69dbdd6520e"}} {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:42:01.525041 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-b6f14a6f-402f-49c4-9a25-ee6660fb8ef1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:01.537184 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-b6f14a6f-402f-49c4-9a25-ee6660fb8ef1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:01.537184 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-b6f14a6f-402f-49c4-9a25-ee6660fb8ef1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:01.538031 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-b6f14a6f-402f-49c4-9a25-ee6660fb8ef1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:01.538478 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-b6f14a6f-402f-49c4-9a25-ee6660fb8ef1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:01.572681 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.virt.hardware [None req-d5ed63c8-9321-4cfd-b29d-580971bee8c7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Flavor limits 0:0:0 {{(pid=118117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 16:42:01.573687 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.virt.hardware [None req-d5ed63c8-9321-4cfd-b29d-580971bee8c7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Image limits 0:0:0 {{(pid=118117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 16:42:01.574269 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.virt.hardware [None req-d5ed63c8-9321-4cfd-b29d-580971bee8c7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Flavor pref 0:0:0 {{(pid=118117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 16:42:01.574653 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.virt.hardware [None req-d5ed63c8-9321-4cfd-b29d-580971bee8c7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Image pref 0:0:0 {{(pid=118117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 16:42:01.575285 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.virt.hardware [None req-d5ed63c8-9321-4cfd-b29d-580971bee8c7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 16:42:01.585357 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-d5ed63c8-9321-4cfd-b29d-580971bee8c7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:01.585891 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-d5ed63c8-9321-4cfd-b29d-580971bee8c7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:01.586746 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-d5ed63c8-9321-4cfd-b29d-580971bee8c7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:01.587233 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-d5ed63c8-9321-4cfd-b29d-580971bee8c7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:01.607880 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.quota [None req-d5ed63c8-9321-4cfd-b29d-580971bee8c7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Getting quotas for project dbd6814591334db58a37092eb04729fb. Resources: {'cores', 'ram', 'instances'} {{(pid=118117) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 16:42:01.613479 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.quota [None req-d5ed63c8-9321-4cfd-b29d-580971bee8c7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Getting quotas for user 4294d6dff5054da7afcb37b8b28f1a01 and project dbd6814591334db58a37092eb04729fb. Resources: {'cores', 'ram', 'instances'} {{(pid=118117) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 16:42:01.625988 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-d5ed63c8-9321-4cfd-b29d-580971bee8c7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Going to run 1 instances... {{(pid=118117) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 16:42:01.628517 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-d5ed63c8-9321-4cfd-b29d-580971bee8c7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: 87f86dcf-be4f-4fb9-9957-d2c5c10d999c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c9cb5329-85cb-4472-935d-c4ea1d1f0592',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118117) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 16:42:01.678740 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-d5ed63c8-9321-4cfd-b29d-580971bee8c7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.273434 Aug 01 16:42:01.685898 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 204/418] 10.222.0.45 () {60 vars in 1147 bytes} [Mon Aug 1 16:42:00 2022] POST /compute/v2.1/servers => generated 409 bytes in 1281 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 16:42:01.692246 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-29d2439d-38d7-48dc-9436-e572b8b0ef71 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:01.693142 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-29d2439d-38d7-48dc-9436-e572b8b0ef71 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: 87f86dcf-be4f-4fb9-9957-d2c5c10d999c] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:01.757197 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-29d2439d-38d7-48dc-9436-e572b8b0ef71 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:01.765295 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-29d2439d-38d7-48dc-9436-e572b8b0ef71 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c" status: 200 len: 1245 microversion: 2.1 time: 0.077777 Aug 01 16:42:01.766489 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 205/419] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:42:01 2022] GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c => generated 1245 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:42:01.816753 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [req-ed21e241-8e0d-47fa-b672-24c894f26a50 req-e682ca79-4547-4ec5-bdb3-014269dadc2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbaee35c-998a-40a8-ba66-c13974b81cae", "name": "network-vif-plugged", "status": "completed", "tag": "032bf1e8-9936-40fa-83f9-d6b7410b1d78"}]} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:42:01.838406 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-ed21e241-8e0d-47fa-b672-24c894f26a50 req-e682ca79-4547-4ec5-bdb3-014269dadc2b service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:01.839040 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-ed21e241-8e0d-47fa-b672-24c894f26a50 req-e682ca79-4547-4ec5-bdb3-014269dadc2b service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:01.855858 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.compute.server_external_events [req-ed21e241-8e0d-47fa-b672-24c894f26a50 req-e682ca79-4547-4ec5-bdb3-014269dadc2b service nova] Creating event network-vif-plugged:032bf1e8-9936-40fa-83f9-d6b7410b1d78 for instance dbaee35c-998a-40a8-ba66-c13974b81cae on hv-cinder-85032 Aug 01 16:42:01.864264 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [req-ed21e241-8e0d-47fa-b672-24c894f26a50 req-e682ca79-4547-4ec5-bdb3-014269dadc2b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052624 Aug 01 16:42:01.865262 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 206/420] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:42:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 16:42:02.042266 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-b6f14a6f-402f-49c4-9a25-ee6660fb8ef1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "POST /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.524468 Aug 01 16:42:02.043308 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 215/421] 10.222.0.45 () {62 vars in 1364 bytes} [Mon Aug 1 16:42:01 2022] POST /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e/os-volume_attachments => generated 188 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 16:42:02.168646 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-1dc01cd8-7f2f-4da6-a271-894a5f48261a tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:02.171664 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-1dc01cd8-7f2f-4da6-a271-894a5f48261a tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] [instance: dbaee35c-998a-40a8-ba66-c13974b81cae] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:02.181646 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-1dc01cd8-7f2f-4da6-a271-894a5f48261a tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:02.182323 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-1dc01cd8-7f2f-4da6-a271-894a5f48261a tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:02.183202 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-1dc01cd8-7f2f-4da6-a271-894a5f48261a tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:02.183628 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-1dc01cd8-7f2f-4da6-a271-894a5f48261a tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:02.196920 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-9b276b01-150e-4304-a987-1bcdc76656db tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:42:02.197689 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-9b276b01-150e-4304-a987-1bcdc76656db tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:02.204045 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-9b276b01-150e-4304-a987-1bcdc76656db tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:02.204716 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-9b276b01-150e-4304-a987-1bcdc76656db tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:02.205662 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-9b276b01-150e-4304-a987-1bcdc76656db tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:02.206471 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-9b276b01-150e-4304-a987-1bcdc76656db tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:02.272917 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-9b276b01-150e-4304-a987-1bcdc76656db tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118118) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 01 16:42:02.394427 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-9b276b01-150e-4304-a987-1bcdc76656db tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "POST /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e/action" status: 202 len: 0 microversion: 2.20 time: 0.201286 Aug 01 16:42:02.395272 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 216/422] 10.222.0.45 () {62 vars in 1319 bytes} [Mon Aug 1 16:42:02 2022] POST /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 01 16:42:02.403972 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-49eb0d69-e02f-43fa-829b-22999f363f37 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:02.404270 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-49eb0d69-e02f-43fa-829b-22999f363f37 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:02.419639 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-49eb0d69-e02f-43fa-829b-22999f363f37 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:02.420103 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-49eb0d69-e02f-43fa-829b-22999f363f37 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:02.421109 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-49eb0d69-e02f-43fa-829b-22999f363f37 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:02.421549 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-49eb0d69-e02f-43fa-829b-22999f363f37 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:02.481807 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-1dc01cd8-7f2f-4da6-a271-894a5f48261a tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a8231119f34ef98b8a85303c5c447e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08c78acd1db446bac4352f66e792085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:02.489521 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-1dc01cd8-7f2f-4da6-a271-894a5f48261a tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] 10.222.0.45 "GET /compute/v2.1/servers/dbaee35c-998a-40a8-ba66-c13974b81cae" status: 200 len: 1314 microversion: 2.1 time: 0.325842 Aug 01 16:42:02.490099 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 207/423] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:42:02 2022] GET /compute/v2.1/servers/dbaee35c-998a-40a8-ba66-c13974b81cae => generated 1314 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:42:02.609209 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-49eb0d69-e02f-43fa-829b-22999f363f37 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:02.620489 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-49eb0d69-e02f-43fa-829b-22999f363f37 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:02.622488 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-49eb0d69-e02f-43fa-829b-22999f363f37 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:02.623662 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-49eb0d69-e02f-43fa-829b-22999f363f37 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1751 microversion: 2.20 time: 0.224033 Aug 01 16:42:02.624312 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 217/424] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:42:02 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1751 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 16:42:02.787602 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-e0acc42f-58be-4e29-b008-460c4b6c7641 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:02.788320 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-e0acc42f-58be-4e29-b008-460c4b6c7641 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: 87f86dcf-be4f-4fb9-9957-d2c5c10d999c] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:02.794481 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-e0acc42f-58be-4e29-b008-460c4b6c7641 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:02.795059 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-e0acc42f-58be-4e29-b008-460c4b6c7641 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:02.795951 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-e0acc42f-58be-4e29-b008-460c4b6c7641 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:02.796477 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-e0acc42f-58be-4e29-b008-460c4b6c7641 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:02.866422 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-e0acc42f-58be-4e29-b008-460c4b6c7641 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:02.874789 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-e0acc42f-58be-4e29-b008-460c4b6c7641 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c" status: 200 len: 1297 microversion: 2.1 time: 0.091225 Aug 01 16:42:02.875704 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 208/425] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:42:02 2022] GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c => generated 1297 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:42:03.510801 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-094393e7-abbc-4424-a143-a1997f37c509 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:03.511636 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-094393e7-abbc-4424-a143-a1997f37c509 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] [instance: dbaee35c-998a-40a8-ba66-c13974b81cae] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:03.518021 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-094393e7-abbc-4424-a143-a1997f37c509 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:03.518553 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-094393e7-abbc-4424-a143-a1997f37c509 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:03.519323 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-094393e7-abbc-4424-a143-a1997f37c509 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:03.519754 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-094393e7-abbc-4424-a143-a1997f37c509 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:03.647983 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-6d809cbd-c1f3-4fb7-8264-493ede43375c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:03.648889 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-6d809cbd-c1f3-4fb7-8264-493ede43375c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:03.655698 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-6d809cbd-c1f3-4fb7-8264-493ede43375c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:03.656539 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-6d809cbd-c1f3-4fb7-8264-493ede43375c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:03.657462 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-6d809cbd-c1f3-4fb7-8264-493ede43375c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:03.658032 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-6d809cbd-c1f3-4fb7-8264-493ede43375c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:03.673303 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-094393e7-abbc-4424-a143-a1997f37c509 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a8231119f34ef98b8a85303c5c447e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08c78acd1db446bac4352f66e792085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:03.681374 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-094393e7-abbc-4424-a143-a1997f37c509 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] 10.222.0.45 "GET /compute/v2.1/servers/dbaee35c-998a-40a8-ba66-c13974b81cae" status: 200 len: 1314 microversion: 2.1 time: 0.174364 Aug 01 16:42:03.686839 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 218/426] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:42:03 2022] GET /compute/v2.1/servers/dbaee35c-998a-40a8-ba66-c13974b81cae => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:42:03.898597 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-e1fa8efa-77cd-47d5-906c-b438fd958cc5 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:03.899293 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-e1fa8efa-77cd-47d5-906c-b438fd958cc5 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: 87f86dcf-be4f-4fb9-9957-d2c5c10d999c] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:03.908803 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-e1fa8efa-77cd-47d5-906c-b438fd958cc5 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:03.912333 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-e1fa8efa-77cd-47d5-906c-b438fd958cc5 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:03.913506 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-e1fa8efa-77cd-47d5-906c-b438fd958cc5 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:03.915415 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-e1fa8efa-77cd-47d5-906c-b438fd958cc5 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:03.931270 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-6d809cbd-c1f3-4fb7-8264-493ede43375c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:03.945432 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-6d809cbd-c1f3-4fb7-8264-493ede43375c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:03.948683 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-6d809cbd-c1f3-4fb7-8264-493ede43375c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:03.950810 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-6d809cbd-c1f3-4fb7-8264-493ede43375c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1751 microversion: 2.20 time: 0.306883 Aug 01 16:42:03.952522 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 209/427] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:42:03 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1751 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:42:03.992630 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-e1fa8efa-77cd-47d5-906c-b438fd958cc5 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:04.001023 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-e1fa8efa-77cd-47d5-906c-b438fd958cc5 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c" status: 200 len: 1303 microversion: 2.1 time: 0.109065 Aug 01 16:42:04.001863 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 219/428] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:42:03 2022] GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c => generated 1303 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:42:04.706560 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-f09d77ec-18ad-48ed-8006-9c710a3f79c6 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:04.707314 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-f09d77ec-18ad-48ed-8006-9c710a3f79c6 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] [instance: dbaee35c-998a-40a8-ba66-c13974b81cae] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:04.714852 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-f09d77ec-18ad-48ed-8006-9c710a3f79c6 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:04.715521 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-f09d77ec-18ad-48ed-8006-9c710a3f79c6 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:04.716516 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-f09d77ec-18ad-48ed-8006-9c710a3f79c6 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:04.717084 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-f09d77ec-18ad-48ed-8006-9c710a3f79c6 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:04.722019 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:42:04.926965 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-f09d77ec-18ad-48ed-8006-9c710a3f79c6 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a8231119f34ef98b8a85303c5c447e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08c78acd1db446bac4352f66e792085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:04.939992 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-f09d77ec-18ad-48ed-8006-9c710a3f79c6 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] 10.222.0.45 "GET /compute/v2.1/servers/dbaee35c-998a-40a8-ba66-c13974b81cae" status: 200 len: 1497 microversion: 2.1 time: 0.237357 Aug 01 16:42:04.941640 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 210/429] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:42:04 2022] GET /compute/v2.1/servers/dbaee35c-998a-40a8-ba66-c13974b81cae => generated 1497 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:42:04.979683 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-b8286239-4f3a-4195-b4fa-2d4ce6864451 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:04.981061 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-b8286239-4f3a-4195-b4fa-2d4ce6864451 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:04.990622 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-b8286239-4f3a-4195-b4fa-2d4ce6864451 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:04.991088 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-b8286239-4f3a-4195-b4fa-2d4ce6864451 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:04.992187 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-b8286239-4f3a-4195-b4fa-2d4ce6864451 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:04.992761 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-b8286239-4f3a-4195-b4fa-2d4ce6864451 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:05.024994 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-beb66025-c440-4984-a4cb-460343f0de33 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:05.027348 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-beb66025-c440-4984-a4cb-460343f0de33 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: 87f86dcf-be4f-4fb9-9957-d2c5c10d999c] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:05.036632 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-beb66025-c440-4984-a4cb-460343f0de33 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:05.037112 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-beb66025-c440-4984-a4cb-460343f0de33 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:05.038428 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-beb66025-c440-4984-a4cb-460343f0de33 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:05.038940 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-beb66025-c440-4984-a4cb-460343f0de33 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:05.153022 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-beb66025-c440-4984-a4cb-460343f0de33 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:05.164618 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-beb66025-c440-4984-a4cb-460343f0de33 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c" status: 200 len: 1303 microversion: 2.1 time: 0.145183 Aug 01 16:42:05.165812 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 211/430] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:42:05 2022] GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c => generated 1303 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:42:05.267344 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-b8286239-4f3a-4195-b4fa-2d4ce6864451 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:05.278577 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-b8286239-4f3a-4195-b4fa-2d4ce6864451 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:05.280578 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-b8286239-4f3a-4195-b4fa-2d4ce6864451 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:05.282112 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-b8286239-4f3a-4195-b4fa-2d4ce6864451 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1753 microversion: 2.20 time: 0.311531 Aug 01 16:42:05.297159 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 220/431] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:42:04 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1753 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:42:05.491836 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-708b53a7-8f87-4cec-a08e-b6ad91b7c889 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:42:05.495192 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-708b53a7-8f87-4cec-a08e-b6ad91b7c889 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] [instance: 348b2621-1bf9-431b-b639-9aabbf68a3cf] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:05.503549 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-708b53a7-8f87-4cec-a08e-b6ad91b7c889 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:05.504025 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-708b53a7-8f87-4cec-a08e-b6ad91b7c889 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:05.505341 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-708b53a7-8f87-4cec-a08e-b6ad91b7c889 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:05.505816 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-708b53a7-8f87-4cec-a08e-b6ad91b7c889 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:05.609499 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-290d249b-f377-45f6-b981-99bca3e90dcd tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:05.609957 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-290d249b-f377-45f6-b981-99bca3e90dcd tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] [instance: dbaee35c-998a-40a8-ba66-c13974b81cae] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:05.615720 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-708b53a7-8f87-4cec-a08e-b6ad91b7c889 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] 10.222.0.45 "POST /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf/action" status: 202 len: 0 microversion: 2.1 time: 0.128511 Aug 01 16:42:05.616977 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 212/432] 10.222.0.45 () {60 vars in 1278 bytes} [Mon Aug 1 16:42:05 2022] POST /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 16:42:05.617751 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-290d249b-f377-45f6-b981-99bca3e90dcd tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:05.618180 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-290d249b-f377-45f6-b981-99bca3e90dcd tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:05.619119 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-290d249b-f377-45f6-b981-99bca3e90dcd tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:05.619556 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-290d249b-f377-45f6-b981-99bca3e90dcd tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:05.625621 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-70e0b5a5-c574-4fcc-bf61-ee5180736473 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:05.626587 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-70e0b5a5-c574-4fcc-bf61-ee5180736473 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] [instance: 348b2621-1bf9-431b-b639-9aabbf68a3cf] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:05.634518 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-70e0b5a5-c574-4fcc-bf61-ee5180736473 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:05.635186 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-70e0b5a5-c574-4fcc-bf61-ee5180736473 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:05.636156 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-70e0b5a5-c574-4fcc-bf61-ee5180736473 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:05.636725 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-70e0b5a5-c574-4fcc-bf61-ee5180736473 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:05.659799 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-290d249b-f377-45f6-b981-99bca3e90dcd tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] [instance: dbaee35c-998a-40a8-ba66-c13974b81cae] Going to try to terminate instance {{(pid=118118) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 16:42:05.823079 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-290d249b-f377-45f6-b981-99bca3e90dcd tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] 10.222.0.45 "DELETE /compute/v2.1/servers/dbaee35c-998a-40a8-ba66-c13974b81cae" status: 204 len: 0 microversion: 2.1 time: 0.217448 Aug 01 16:42:05.823931 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 221/433] 10.222.0.45 () {58 vars in 1239 bytes} [Mon Aug 1 16:42:05 2022] DELETE /compute/v2.1/servers/dbaee35c-998a-40a8-ba66-c13974b81cae => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 16:42:05.836396 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-06750235-305d-4855-a4ce-876c1be669dc tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:05.838088 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-06750235-305d-4855-a4ce-876c1be669dc tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] [instance: dbaee35c-998a-40a8-ba66-c13974b81cae] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:05.854468 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-06750235-305d-4855-a4ce-876c1be669dc tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:05.855097 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-06750235-305d-4855-a4ce-876c1be669dc tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:05.856031 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-06750235-305d-4855-a4ce-876c1be669dc tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:05.856645 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-06750235-305d-4855-a4ce-876c1be669dc tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:06.134950 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-70e0b5a5-c574-4fcc-bf61-ee5180736473 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a95d9f48c64b0fbb8879d361bc177d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019734069da44b2d88561549bd07544d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:06.146581 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-70e0b5a5-c574-4fcc-bf61-ee5180736473 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] 10.222.0.45 "GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf" status: 200 len: 1752 microversion: 2.1 time: 0.522966 Aug 01 16:42:06.147194 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 213/434] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:42:05 2022] GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf => generated 1752 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:42:06.180622 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-06750235-305d-4855-a4ce-876c1be669dc tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a8231119f34ef98b8a85303c5c447e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08c78acd1db446bac4352f66e792085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:06.186762 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-f522f161-d87e-4efe-8dd0-d048afcb2336 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:06.187565 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-f522f161-d87e-4efe-8dd0-d048afcb2336 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: 87f86dcf-be4f-4fb9-9957-d2c5c10d999c] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:06.190083 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-06750235-305d-4855-a4ce-876c1be669dc tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] 10.222.0.45 "GET /compute/v2.1/servers/dbaee35c-998a-40a8-ba66-c13974b81cae" status: 200 len: 1503 microversion: 2.1 time: 0.360938 Aug 01 16:42:06.190880 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 222/435] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:42:05 2022] GET /compute/v2.1/servers/dbaee35c-998a-40a8-ba66-c13974b81cae => generated 1503 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:42:06.208171 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-f522f161-d87e-4efe-8dd0-d048afcb2336 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:06.208610 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-f522f161-d87e-4efe-8dd0-d048afcb2336 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:06.209405 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-f522f161-d87e-4efe-8dd0-d048afcb2336 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:06.209962 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-f522f161-d87e-4efe-8dd0-d048afcb2336 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:06.307627 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-21d6ac8b-da48-4959-a4a9-cec961da6919 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:06.308355 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-21d6ac8b-da48-4959-a4a9-cec961da6919 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:06.315165 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-21d6ac8b-da48-4959-a4a9-cec961da6919 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:06.315663 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-21d6ac8b-da48-4959-a4a9-cec961da6919 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:06.316542 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-21d6ac8b-da48-4959-a4a9-cec961da6919 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:06.316972 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-21d6ac8b-da48-4959-a4a9-cec961da6919 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:06.460451 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-f522f161-d87e-4efe-8dd0-d048afcb2336 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:06.468318 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-f522f161-d87e-4efe-8dd0-d048afcb2336 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c" status: 200 len: 1371 microversion: 2.1 time: 0.285714 Aug 01 16:42:06.468959 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 214/436] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:42:06 2022] GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c => generated 1371 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:42:06.602386 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-21d6ac8b-da48-4959-a4a9-cec961da6919 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:06.604799 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=5,nova_cell1:UPDATE=6 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:42:06.613386 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-21d6ac8b-da48-4959-a4a9-cec961da6919 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:06.614897 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-21d6ac8b-da48-4959-a4a9-cec961da6919 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:06.616099 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-21d6ac8b-da48-4959-a4a9-cec961da6919 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1809 microversion: 2.20 time: 0.312804 Aug 01 16:42:06.616653 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 223/437] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:42:06 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1809 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:42:06.743810 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [req-9e94884e-3071-4b1f-b50a-3f6802d4057a req-f6f331a7-5930-4e53-b2bc-e3ac8b05d6df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87f86dcf-be4f-4fb9-9957-d2c5c10d999c", "tag": "6e2de669-4a5d-4e6f-be74-46aa73411e81"}]} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:42:06.755847 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-9e94884e-3071-4b1f-b50a-3f6802d4057a req-f6f331a7-5930-4e53-b2bc-e3ac8b05d6df service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:06.756374 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-9e94884e-3071-4b1f-b50a-3f6802d4057a req-f6f331a7-5930-4e53-b2bc-e3ac8b05d6df service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:06.771281 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.compute.server_external_events [req-9e94884e-3071-4b1f-b50a-3f6802d4057a req-f6f331a7-5930-4e53-b2bc-e3ac8b05d6df service nova] Creating event network-changed:6e2de669-4a5d-4e6f-be74-46aa73411e81 for instance 87f86dcf-be4f-4fb9-9957-d2c5c10d999c on hv-cinder-85032 Aug 01 16:42:06.776066 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [req-9e94884e-3071-4b1f-b50a-3f6802d4057a req-f6f331a7-5930-4e53-b2bc-e3ac8b05d6df service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036044 Aug 01 16:42:06.776763 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 215/438] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:42:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:42:07.170549 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-5139929d-540e-4ac2-b6f9-8122e3bac888 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:07.171283 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-5139929d-540e-4ac2-b6f9-8122e3bac888 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] [instance: 348b2621-1bf9-431b-b639-9aabbf68a3cf] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:07.182000 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-5139929d-540e-4ac2-b6f9-8122e3bac888 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:07.183316 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-5139929d-540e-4ac2-b6f9-8122e3bac888 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:07.184272 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-5139929d-540e-4ac2-b6f9-8122e3bac888 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:07.185045 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-5139929d-540e-4ac2-b6f9-8122e3bac888 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:07.213492 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-3493a650-78dc-4e7a-b84c-d349d3a89dd3 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:07.215314 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-3493a650-78dc-4e7a-b84c-d349d3a89dd3 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] [instance: dbaee35c-998a-40a8-ba66-c13974b81cae] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:07.223162 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-3493a650-78dc-4e7a-b84c-d349d3a89dd3 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:07.223991 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-3493a650-78dc-4e7a-b84c-d349d3a89dd3 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:07.224978 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-3493a650-78dc-4e7a-b84c-d349d3a89dd3 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:07.225708 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-3493a650-78dc-4e7a-b84c-d349d3a89dd3 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:08.036890 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-5139929d-540e-4ac2-b6f9-8122e3bac888 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a95d9f48c64b0fbb8879d361bc177d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019734069da44b2d88561549bd07544d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:08.045561 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-5139929d-540e-4ac2-b6f9-8122e3bac888 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] 10.222.0.45 "GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf" status: 200 len: 1752 microversion: 2.1 time: 0.879301 Aug 01 16:42:08.047135 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 224/439] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:42:07 2022] GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf => generated 1752 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:42:08.058095 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-3493a650-78dc-4e7a-b84c-d349d3a89dd3 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6a8231119f34ef98b8a85303c5c447e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08c78acd1db446bac4352f66e792085', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:08.059341 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-31b7ff8c-4275-46f1-a09d-4b40e5cbb623 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:08.060462 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-31b7ff8c-4275-46f1-a09d-4b40e5cbb623 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: 87f86dcf-be4f-4fb9-9957-d2c5c10d999c] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:08.068470 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-3493a650-78dc-4e7a-b84c-d349d3a89dd3 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] 10.222.0.45 "GET /compute/v2.1/servers/dbaee35c-998a-40a8-ba66-c13974b81cae" status: 200 len: 1503 microversion: 2.1 time: 0.859249 Aug 01 16:42:08.068920 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-31b7ff8c-4275-46f1-a09d-4b40e5cbb623 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:08.069503 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 216/440] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:42:07 2022] GET /compute/v2.1/servers/dbaee35c-998a-40a8-ba66-c13974b81cae => generated 1503 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:42:08.069822 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-31b7ff8c-4275-46f1-a09d-4b40e5cbb623 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:08.071490 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-31b7ff8c-4275-46f1-a09d-4b40e5cbb623 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:08.071897 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-31b7ff8c-4275-46f1-a09d-4b40e5cbb623 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:08.085712 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-cf2a6c8a-a7a2-43ea-88a9-b095d716db8d tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:08.086772 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-cf2a6c8a-a7a2-43ea-88a9-b095d716db8d tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:08.098120 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-cf2a6c8a-a7a2-43ea-88a9-b095d716db8d tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:08.098952 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-cf2a6c8a-a7a2-43ea-88a9-b095d716db8d tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:08.100362 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-cf2a6c8a-a7a2-43ea-88a9-b095d716db8d tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:08.101034 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-cf2a6c8a-a7a2-43ea-88a9-b095d716db8d tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:08.252578 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_cell0:SELECT=4 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:42:08.440902 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-31b7ff8c-4275-46f1-a09d-4b40e5cbb623 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:08.445272 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-cf2a6c8a-a7a2-43ea-88a9-b095d716db8d tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:08.449088 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-31b7ff8c-4275-46f1-a09d-4b40e5cbb623 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c" status: 200 len: 1371 microversion: 2.1 time: 0.400585 Aug 01 16:42:08.449669 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 225/441] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:42:08 2022] GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c => generated 1371 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:42:08.455990 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-cf2a6c8a-a7a2-43ea-88a9-b095d716db8d tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:08.457676 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [req-8ea9b149-b825-4138-a5d6-703631146beb req-a9da2855-6fab-4af7-9241-1d37372d1e1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbaee35c-998a-40a8-ba66-c13974b81cae", "name": "network-vif-deleted", "tag": "032bf1e8-9936-40fa-83f9-d6b7410b1d78"}]} {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:42:08.458302 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-cf2a6c8a-a7a2-43ea-88a9-b095d716db8d tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:08.459882 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-cf2a6c8a-a7a2-43ea-88a9-b095d716db8d tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1809 microversion: 2.20 time: 0.388735 Aug 01 16:42:08.460606 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 217/442] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:42:08 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1809 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:42:08.481183 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-8ea9b149-b825-4138-a5d6-703631146beb req-a9da2855-6fab-4af7-9241-1d37372d1e1d service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:08.481621 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-8ea9b149-b825-4138-a5d6-703631146beb req-a9da2855-6fab-4af7-9241-1d37372d1e1d service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:08.498426 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.compute.server_external_events [req-8ea9b149-b825-4138-a5d6-703631146beb req-a9da2855-6fab-4af7-9241-1d37372d1e1d service nova] Creating event network-vif-deleted:032bf1e8-9936-40fa-83f9-d6b7410b1d78 for instance dbaee35c-998a-40a8-ba66-c13974b81cae on hv-cinder-85032 Aug 01 16:42:08.508669 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [req-8ea9b149-b825-4138-a5d6-703631146beb req-a9da2855-6fab-4af7-9241-1d37372d1e1d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056428 Aug 01 16:42:08.508669 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 226/443] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:42:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:42:09.068923 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-e8cc9afd-216a-4014-bdbd-67fe10448c88 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:09.069549 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-e8cc9afd-216a-4014-bdbd-67fe10448c88 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] [instance: 348b2621-1bf9-431b-b639-9aabbf68a3cf] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:09.076242 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-e8cc9afd-216a-4014-bdbd-67fe10448c88 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:09.077287 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-e8cc9afd-216a-4014-bdbd-67fe10448c88 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:09.078126 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-e8cc9afd-216a-4014-bdbd-67fe10448c88 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:09.078568 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-e8cc9afd-216a-4014-bdbd-67fe10448c88 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:09.095808 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-4bcbfad7-7729-4bb1-bd68-82bdbd0e4301 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:09.097931 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-4bcbfad7-7729-4bb1-bd68-82bdbd0e4301 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] [instance: dbaee35c-998a-40a8-ba66-c13974b81cae] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:09.105151 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-4bcbfad7-7729-4bb1-bd68-82bdbd0e4301 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:09.105684 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-4bcbfad7-7729-4bb1-bd68-82bdbd0e4301 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:09.106522 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-4bcbfad7-7729-4bb1-bd68-82bdbd0e4301 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:09.107013 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-4bcbfad7-7729-4bb1-bd68-82bdbd0e4301 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:09.122577 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.wsgi [None req-4bcbfad7-7729-4bb1-bd68-82bdbd0e4301 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] HTTP exception thrown: Instance dbaee35c-998a-40a8-ba66-c13974b81cae could not be found. Aug 01 16:42:09.124804 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-4bcbfad7-7729-4bb1-bd68-82bdbd0e4301 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Request method failure captured: Aug 01 16:42:09.124804 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: request: GET /compute/v2.1/servers/dbaee35c-998a-40a8-ba66-c13974b81cae HTTP/1.1 Aug 01 16:42:09.124804 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Accept: application/json Aug 01 16:42:09.124804 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Accept-Encoding: identity Aug 01 16:42:09.124804 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Connection: close Aug 01 16:42:09.124804 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Content-Length: 0 Aug 01 16:42:09.124804 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Content-Type: application/json Aug 01 16:42:09.124804 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Host: 10.222.0.45 Aug 01 16:42:09.124804 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Openstack-System-Scope: None Aug 01 16:42:09.124804 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: User-Agent: python-urllib3/1.26.10 Aug 01 16:42:09.124804 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Auth-Token: gAAAAABi6AImAXqc3uZ8HS3ewrS9aIT5p8qJrHuxKnKITPZU1_o-IQ5438Fx6izQHKmot2UF3xEH0272fwyNG_nc1e4P0Y6HKxYFa1x6y9ZfCxLFNzJ6QNMucQnIQRAngbOQ8q2QOyo2O8WqS1upXCsf5N83mXDOUxq7f4zGkYk-7c6XeMPuUhI Aug 01 16:42:09.124804 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Domain-Id: None Aug 01 16:42:09.124804 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Domain-Name: None Aug 01 16:42:09.124804 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Identity-Status: Confirmed Aug 01 16:42:09.124804 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Is-Admin-Project: True Aug 01 16:42:09.124804 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Domain-Id: default Aug 01 16:42:09.124804 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Domain-Name: Default Aug 01 16:42:09.124804 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Id: d08c78acd1db446bac4352f66e792085 Aug 01 16:42:09.124804 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Name: tempest-VolumesActionsTest-622644897 Aug 01 16:42:09.124804 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Role: reader,member Aug 01 16:42:09.124804 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Roles: reader,member Aug 01 16:42:09.126350 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_d08c78acd1db446bac4352f66e792085"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/d08c78acd1db446bac4352f66e792085"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d08c78acd1db446bac4352f66e792085"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d08c78acd1db446bac4352f66e792085"}]}] Aug 01 16:42:09.126350 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant: tempest-VolumesActionsTest-622644897 Aug 01 16:42:09.126350 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant-Id: d08c78acd1db446bac4352f66e792085 Aug 01 16:42:09.126350 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant-Name: tempest-VolumesActionsTest-622644897 Aug 01 16:42:09.126350 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User: tempest-VolumesActionsTest-622644897-project Aug 01 16:42:09.126350 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Domain-Id: default Aug 01 16:42:09.126350 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Domain-Name: Default Aug 01 16:42:09.126350 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Id: c6a8231119f34ef98b8a85303c5c447e Aug 01 16:42:09.126350 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Name: tempest-VolumesActionsTest-622644897-project Aug 01 16:42:09.126350 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: method: > Aug 01 16:42:09.126350 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: exception: Instance dbaee35c-998a-40a8-ba66-c13974b81cae could not be found. Aug 01 16:42:09.126350 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: action_args: {'id': 'dbaee35c-998a-40a8-ba66-c13974b81cae'} Aug 01 16:42:09.127231 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:42:09.127231 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:42:09.127231 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 16:42:09.127231 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 16:42:09.127231 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 16:42:09.127231 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 16:42:09.127231 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 16:42:09.127231 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 16:42:09.127231 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 16:42:09.127231 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 16:42:09.127231 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbaee35c-998a-40a8-ba66-c13974b81cae could not be found. Aug 01 16:42:09.127231 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:42:09.127231 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:42:09.127231 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:42:09.127231 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:42:09.127231 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:42:09.127231 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:42:09.127231 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:42:09.127231 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:42:09.127231 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:42:09.128650 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:42:09.128650 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 16:42:09.128650 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 16:42:09.128650 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 16:42:09.128650 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 16:42:09.128650 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 16:42:09.128650 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:42:09.128650 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbaee35c-998a-40a8-ba66-c13974b81cae could not be found. Aug 01 16:42:09.128650 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:42:09.128650 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:42:09.128650 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:42:09.128650 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:42:09.128650 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:42:09.128650 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:42:09.128650 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:42:09.128650 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:42:09.128650 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbaee35c-998a-40a8-ba66-c13974b81cae could not be found. Aug 01 16:42:09.128650 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:42:09.129961 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-4bcbfad7-7729-4bb1-bd68-82bdbd0e4301 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] Returning 404 to user: Instance dbaee35c-998a-40a8-ba66-c13974b81cae could not be found. {{(pid=118118) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:42:09.129961 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-4bcbfad7-7729-4bb1-bd68-82bdbd0e4301 tempest-VolumesActionsTest-622644897 tempest-VolumesActionsTest-622644897-project] 10.222.0.45 "GET /compute/v2.1/servers/dbaee35c-998a-40a8-ba66-c13974b81cae" status: 404 len: 111 microversion: 2.1 time: 0.035119 Aug 01 16:42:09.132197 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 227/444] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:42:09 2022] GET /compute/v2.1/servers/dbaee35c-998a-40a8-ba66-c13974b81cae => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 16:42:09.344409 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-e8cc9afd-216a-4014-bdbd-67fe10448c88 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a95d9f48c64b0fbb8879d361bc177d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019734069da44b2d88561549bd07544d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:09.344409 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-e8cc9afd-216a-4014-bdbd-67fe10448c88 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] 10.222.0.45 "GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf" status: 200 len: 1752 microversion: 2.1 time: 0.277231 Aug 01 16:42:09.344409 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 218/445] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:42:09 2022] GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf => generated 1752 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:42:09.470695 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-0edd130a-6617-4d19-a4d4-73220eb8f0b9 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:09.471444 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-0edd130a-6617-4d19-a4d4-73220eb8f0b9 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: 87f86dcf-be4f-4fb9-9957-d2c5c10d999c] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:09.482838 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-0edd130a-6617-4d19-a4d4-73220eb8f0b9 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:09.483546 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-0edd130a-6617-4d19-a4d4-73220eb8f0b9 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:09.484464 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-0edd130a-6617-4d19-a4d4-73220eb8f0b9 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:09.485805 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-0edd130a-6617-4d19-a4d4-73220eb8f0b9 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:09.487212 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-7950e41c-145a-4686-9918-43e05c0a7f8d tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:09.488986 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-7950e41c-145a-4686-9918-43e05c0a7f8d tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:09.498871 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:42:09.513708 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-7950e41c-145a-4686-9918-43e05c0a7f8d tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:09.514267 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-7950e41c-145a-4686-9918-43e05c0a7f8d tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:09.515258 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-7950e41c-145a-4686-9918-43e05c0a7f8d tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:09.515837 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-7950e41c-145a-4686-9918-43e05c0a7f8d tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:09.712731 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-0edd130a-6617-4d19-a4d4-73220eb8f0b9 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:09.719899 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-7950e41c-145a-4686-9918-43e05c0a7f8d tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:09.721450 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-0edd130a-6617-4d19-a4d4-73220eb8f0b9 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c" status: 200 len: 1371 microversion: 2.1 time: 0.254805 Aug 01 16:42:09.722479 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 228/446] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:42:09 2022] GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c => generated 1371 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:42:09.730191 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-7950e41c-145a-4686-9918-43e05c0a7f8d tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:09.732014 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-7950e41c-145a-4686-9918-43e05c0a7f8d tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:09.733685 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-7950e41c-145a-4686-9918-43e05c0a7f8d tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1809 microversion: 2.20 time: 0.251495 Aug 01 16:42:09.734257 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 219/447] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:42:09 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1809 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:42:10.374085 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-ffa514a3-c526-4e04-a253-2ba23e9724b0 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:10.375169 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-ffa514a3-c526-4e04-a253-2ba23e9724b0 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] [instance: 348b2621-1bf9-431b-b639-9aabbf68a3cf] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:10.382515 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-ffa514a3-c526-4e04-a253-2ba23e9724b0 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:10.382944 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-ffa514a3-c526-4e04-a253-2ba23e9724b0 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:10.383869 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-ffa514a3-c526-4e04-a253-2ba23e9724b0 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:10.384181 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-ffa514a3-c526-4e04-a253-2ba23e9724b0 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:10.537737 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-ffa514a3-c526-4e04-a253-2ba23e9724b0 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a95d9f48c64b0fbb8879d361bc177d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019734069da44b2d88561549bd07544d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:10.546698 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-ffa514a3-c526-4e04-a253-2ba23e9724b0 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] 10.222.0.45 "GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf" status: 200 len: 1757 microversion: 2.1 time: 0.176932 Aug 01 16:42:10.547266 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 229/448] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:42:10 2022] GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf => generated 1757 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:42:10.742920 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-2512b597-0961-4e3b-b21a-7279dfe57b5d tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:10.743590 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-2512b597-0961-4e3b-b21a-7279dfe57b5d tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: 87f86dcf-be4f-4fb9-9957-d2c5c10d999c] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:10.751517 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-2512b597-0961-4e3b-b21a-7279dfe57b5d tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:10.752003 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-2512b597-0961-4e3b-b21a-7279dfe57b5d tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:10.752767 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-2512b597-0961-4e3b-b21a-7279dfe57b5d tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:10.753212 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-2512b597-0961-4e3b-b21a-7279dfe57b5d tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:10.760579 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-b45c8b9f-da7c-4800-86bf-59aede8292c1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:10.761485 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-b45c8b9f-da7c-4800-86bf-59aede8292c1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:10.768582 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-b45c8b9f-da7c-4800-86bf-59aede8292c1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:10.769049 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-b45c8b9f-da7c-4800-86bf-59aede8292c1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:10.769883 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-b45c8b9f-da7c-4800-86bf-59aede8292c1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:10.770294 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-b45c8b9f-da7c-4800-86bf-59aede8292c1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:10.962538 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-2512b597-0961-4e3b-b21a-7279dfe57b5d tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:10.966266 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-b45c8b9f-da7c-4800-86bf-59aede8292c1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:10.970913 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-2512b597-0961-4e3b-b21a-7279dfe57b5d tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c" status: 200 len: 1371 microversion: 2.1 time: 0.232091 Aug 01 16:42:10.973489 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 220/449] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:42:10 2022] GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c => generated 1371 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:42:10.979795 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-b45c8b9f-da7c-4800-86bf-59aede8292c1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:10.981595 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-b45c8b9f-da7c-4800-86bf-59aede8292c1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:10.983487 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-b45c8b9f-da7c-4800-86bf-59aede8292c1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1809 microversion: 2.20 time: 0.226541 Aug 01 16:42:10.984925 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 230/450] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:42:10 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1809 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:42:11.568513 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-9836296d-1d38-4c71-81c5-1087e0af0399 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:11.569132 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-9836296d-1d38-4c71-81c5-1087e0af0399 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] [instance: 348b2621-1bf9-431b-b639-9aabbf68a3cf] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:11.575637 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-9836296d-1d38-4c71-81c5-1087e0af0399 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:11.576120 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-9836296d-1d38-4c71-81c5-1087e0af0399 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:11.576938 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-9836296d-1d38-4c71-81c5-1087e0af0399 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:11.577393 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-9836296d-1d38-4c71-81c5-1087e0af0399 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:11.595691 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_cell0:SELECT=2 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:42:11.738758 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-9836296d-1d38-4c71-81c5-1087e0af0399 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a95d9f48c64b0fbb8879d361bc177d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019734069da44b2d88561549bd07544d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:11.747637 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-9836296d-1d38-4c71-81c5-1087e0af0399 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] 10.222.0.45 "GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf" status: 200 len: 1757 microversion: 2.1 time: 0.182835 Aug 01 16:42:11.748510 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 221/451] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:42:11 2022] GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf => generated 1757 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:42:11.995520 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-de158121-b2a7-4ec6-a26e-9cf92764cb6d tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:11.996054 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-de158121-b2a7-4ec6-a26e-9cf92764cb6d tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: 87f86dcf-be4f-4fb9-9957-d2c5c10d999c] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:12.003913 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-de158121-b2a7-4ec6-a26e-9cf92764cb6d tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:12.004367 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-de158121-b2a7-4ec6-a26e-9cf92764cb6d tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:12.005902 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-de158121-b2a7-4ec6-a26e-9cf92764cb6d tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:12.006769 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-de158121-b2a7-4ec6-a26e-9cf92764cb6d tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:12.008218 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-31898ebb-29db-4e69-b548-fa14691315d8 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:12.008964 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-31898ebb-29db-4e69-b548-fa14691315d8 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:12.016169 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_cell0:SELECT=8 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:42:12.020771 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-31898ebb-29db-4e69-b548-fa14691315d8 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:12.021231 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-31898ebb-29db-4e69-b548-fa14691315d8 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:12.022029 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-31898ebb-29db-4e69-b548-fa14691315d8 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:12.022461 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-31898ebb-29db-4e69-b548-fa14691315d8 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:12.224881 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-de158121-b2a7-4ec6-a26e-9cf92764cb6d tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:12.229784 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-31898ebb-29db-4e69-b548-fa14691315d8 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:12.239409 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-31898ebb-29db-4e69-b548-fa14691315d8 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:12.240378 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-de158121-b2a7-4ec6-a26e-9cf92764cb6d tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c" status: 200 len: 1371 microversion: 2.1 time: 0.248621 Aug 01 16:42:12.241435 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 231/452] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:42:11 2022] GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c => generated 1371 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:42:12.241524 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-31898ebb-29db-4e69-b548-fa14691315d8 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:12.242215 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-31898ebb-29db-4e69-b548-fa14691315d8 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1809 microversion: 2.20 time: 0.239102 Aug 01 16:42:12.242912 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 222/453] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:42:12 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1809 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:42:12.773159 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-8e19c934-864a-40c7-a94e-67c7dad234da tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:12.774262 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-8e19c934-864a-40c7-a94e-67c7dad234da tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] [instance: 348b2621-1bf9-431b-b639-9aabbf68a3cf] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:12.781814 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-8e19c934-864a-40c7-a94e-67c7dad234da tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:12.782339 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-8e19c934-864a-40c7-a94e-67c7dad234da tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:12.783683 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-8e19c934-864a-40c7-a94e-67c7dad234da tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:12.784430 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-8e19c934-864a-40c7-a94e-67c7dad234da tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:12.947892 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-8e19c934-864a-40c7-a94e-67c7dad234da tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a95d9f48c64b0fbb8879d361bc177d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019734069da44b2d88561549bd07544d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:12.959992 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-8e19c934-864a-40c7-a94e-67c7dad234da tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] 10.222.0.45 "GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf" status: 200 len: 1757 microversion: 2.1 time: 0.190894 Aug 01 16:42:12.960890 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 232/454] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:42:12 2022] GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf => generated 1757 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:42:13.265507 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-39bdb7db-95cf-43ad-8234-11379f8d9912 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:13.266190 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-39bdb7db-95cf-43ad-8234-11379f8d9912 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: 87f86dcf-be4f-4fb9-9957-d2c5c10d999c] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:13.268084 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-d84cad48-5b81-4be9-aba9-07095de3b116 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:13.268999 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-d84cad48-5b81-4be9-aba9-07095de3b116 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:13.273555 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-39bdb7db-95cf-43ad-8234-11379f8d9912 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:13.273977 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-39bdb7db-95cf-43ad-8234-11379f8d9912 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:13.274765 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-39bdb7db-95cf-43ad-8234-11379f8d9912 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:13.275178 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-39bdb7db-95cf-43ad-8234-11379f8d9912 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:13.278293 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-d84cad48-5b81-4be9-aba9-07095de3b116 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:13.278959 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-d84cad48-5b81-4be9-aba9-07095de3b116 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:13.281845 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-d84cad48-5b81-4be9-aba9-07095de3b116 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:13.282281 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-d84cad48-5b81-4be9-aba9-07095de3b116 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:13.524370 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-39bdb7db-95cf-43ad-8234-11379f8d9912 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:13.535938 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-39bdb7db-95cf-43ad-8234-11379f8d9912 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c" status: 200 len: 1371 microversion: 2.1 time: 0.276643 Aug 01 16:42:13.537259 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 223/455] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:42:13 2022] GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c => generated 1371 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:42:13.542737 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-d84cad48-5b81-4be9-aba9-07095de3b116 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:13.558410 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-d84cad48-5b81-4be9-aba9-07095de3b116 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:13.560507 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-d84cad48-5b81-4be9-aba9-07095de3b116 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:13.561961 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-d84cad48-5b81-4be9-aba9-07095de3b116 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1809 microversion: 2.20 time: 0.300695 Aug 01 16:42:13.562710 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 233/456] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:42:13 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1809 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:42:13.994822 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-6c491d2e-64d6-4465-a1ec-c767737de515 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:13.995528 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-6c491d2e-64d6-4465-a1ec-c767737de515 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] [instance: 348b2621-1bf9-431b-b639-9aabbf68a3cf] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:14.002811 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-6c491d2e-64d6-4465-a1ec-c767737de515 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:14.003287 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-6c491d2e-64d6-4465-a1ec-c767737de515 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:14.004350 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-6c491d2e-64d6-4465-a1ec-c767737de515 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:14.004867 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-6c491d2e-64d6-4465-a1ec-c767737de515 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:14.188137 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-6c491d2e-64d6-4465-a1ec-c767737de515 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a95d9f48c64b0fbb8879d361bc177d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019734069da44b2d88561549bd07544d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:14.197278 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-6c491d2e-64d6-4465-a1ec-c767737de515 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] 10.222.0.45 "GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf" status: 200 len: 1757 microversion: 2.1 time: 0.207977 Aug 01 16:42:14.197873 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 224/457] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:42:13 2022] GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf => generated 1757 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:42:14.568461 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-9af549f1-989c-4e09-968b-0704824baba9 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:14.569293 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-9af549f1-989c-4e09-968b-0704824baba9 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: 87f86dcf-be4f-4fb9-9957-d2c5c10d999c] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:14.586930 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-9af549f1-989c-4e09-968b-0704824baba9 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:14.587389 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-9af549f1-989c-4e09-968b-0704824baba9 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:14.588404 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-9af549f1-989c-4e09-968b-0704824baba9 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:14.589231 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-9af549f1-989c-4e09-968b-0704824baba9 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:14.590702 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-c2e015a1-e763-43c0-b2a5-4faf50c2186d tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:14.591360 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-c2e015a1-e763-43c0-b2a5-4faf50c2186d tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:14.606891 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-c2e015a1-e763-43c0-b2a5-4faf50c2186d tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:14.614057 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-c2e015a1-e763-43c0-b2a5-4faf50c2186d tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:14.616601 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-c2e015a1-e763-43c0-b2a5-4faf50c2186d tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:14.617455 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-c2e015a1-e763-43c0-b2a5-4faf50c2186d tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:15.410464 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-9af549f1-989c-4e09-968b-0704824baba9 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:15.414577 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-c2e015a1-e763-43c0-b2a5-4faf50c2186d tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:15.424343 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-c2e015a1-e763-43c0-b2a5-4faf50c2186d tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:15.425935 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-c2e015a1-e763-43c0-b2a5-4faf50c2186d tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:15.427217 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-c2e015a1-e763-43c0-b2a5-4faf50c2186d tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1809 microversion: 2.20 time: 0.840672 Aug 01 16:42:15.440554 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 225/458] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:42:14 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1809 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 16:42:15.450530 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-7d905ea3-546c-45df-a275-6c4d786891e7 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:15.451570 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-7d905ea3-546c-45df-a275-6c4d786891e7 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] [instance: 348b2621-1bf9-431b-b639-9aabbf68a3cf] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:15.460123 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-7d905ea3-546c-45df-a275-6c4d786891e7 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:15.461499 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-7d905ea3-546c-45df-a275-6c4d786891e7 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:15.462481 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-7d905ea3-546c-45df-a275-6c4d786891e7 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:15.462923 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-7d905ea3-546c-45df-a275-6c4d786891e7 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:15.482132 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-9af549f1-989c-4e09-968b-0704824baba9 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c" status: 200 len: 1371 microversion: 2.1 time: 0.921953 Aug 01 16:42:15.483374 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 234/459] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:42:14 2022] GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c => generated 1371 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:42:15.484601 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:42:15.784535 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-7d905ea3-546c-45df-a275-6c4d786891e7 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a95d9f48c64b0fbb8879d361bc177d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019734069da44b2d88561549bd07544d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:15.804301 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-7d905ea3-546c-45df-a275-6c4d786891e7 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] 10.222.0.45 "GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf" status: 200 len: 1757 microversion: 2.1 time: 0.362290 Aug 01 16:42:15.805967 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 226/460] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:42:15 2022] GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf => generated 1757 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:42:16.458144 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-7c50f311-8c91-4728-9a12-3415585d5c9f tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:16.460393 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-7c50f311-8c91-4728-9a12-3415585d5c9f tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:16.492749 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-7c50f311-8c91-4728-9a12-3415585d5c9f tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:16.493214 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-7c50f311-8c91-4728-9a12-3415585d5c9f tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:16.501141 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-7c50f311-8c91-4728-9a12-3415585d5c9f tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:16.501905 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-7c50f311-8c91-4728-9a12-3415585d5c9f tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:16.512535 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-83a4b0cf-31d3-4224-85fb-cdd9bb9969b6 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:16.513184 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-83a4b0cf-31d3-4224-85fb-cdd9bb9969b6 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: 87f86dcf-be4f-4fb9-9957-d2c5c10d999c] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:16.530254 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-83a4b0cf-31d3-4224-85fb-cdd9bb9969b6 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:16.530837 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-83a4b0cf-31d3-4224-85fb-cdd9bb9969b6 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:16.531676 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-83a4b0cf-31d3-4224-85fb-cdd9bb9969b6 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:16.532158 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-83a4b0cf-31d3-4224-85fb-cdd9bb9969b6 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:17.013974 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-7c50f311-8c91-4728-9a12-3415585d5c9f tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:17.026816 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-7c50f311-8c91-4728-9a12-3415585d5c9f tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:17.028445 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-7c50f311-8c91-4728-9a12-3415585d5c9f tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:17.030942 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-7c50f311-8c91-4728-9a12-3415585d5c9f tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1809 microversion: 2.20 time: 0.579736 Aug 01 16:42:17.058158 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-83a4b0cf-31d3-4224-85fb-cdd9bb9969b6 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:17.064292 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 235/461] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:42:16 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1809 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:42:17.075390 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-83a4b0cf-31d3-4224-85fb-cdd9bb9969b6 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c" status: 200 len: 1371 microversion: 2.1 time: 0.567301 Aug 01 16:42:17.076184 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 227/462] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:42:16 2022] GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c => generated 1371 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:42:17.076380 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-2e422aa7-8ac7-42ea-b6ef-0644444abf80 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:17.077774 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-2e422aa7-8ac7-42ea-b6ef-0644444abf80 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] [instance: 348b2621-1bf9-431b-b639-9aabbf68a3cf] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:17.086505 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-2e422aa7-8ac7-42ea-b6ef-0644444abf80 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:17.086964 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-2e422aa7-8ac7-42ea-b6ef-0644444abf80 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:17.099549 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-2e422aa7-8ac7-42ea-b6ef-0644444abf80 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:17.100135 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-2e422aa7-8ac7-42ea-b6ef-0644444abf80 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:17.330243 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-2e422aa7-8ac7-42ea-b6ef-0644444abf80 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a95d9f48c64b0fbb8879d361bc177d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019734069da44b2d88561549bd07544d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:17.346465 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-2e422aa7-8ac7-42ea-b6ef-0644444abf80 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] 10.222.0.45 "GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf" status: 200 len: 1757 microversion: 2.1 time: 0.280867 Aug 01 16:42:17.347484 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 236/463] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:42:17 2022] GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf => generated 1757 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:42:17.944398 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [req-a918555a-eaf5-41e6-9f43-6621a6d037b0 req-6f58120c-a09a-458a-a0b9-07343b58f7b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87f86dcf-be4f-4fb9-9957-d2c5c10d999c", "name": "network-vif-plugged", "status": "completed", "tag": "6e2de669-4a5d-4e6f-be74-46aa73411e81"}]} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:42:17.964172 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-a918555a-eaf5-41e6-9f43-6621a6d037b0 req-6f58120c-a09a-458a-a0b9-07343b58f7b5 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:17.964639 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-a918555a-eaf5-41e6-9f43-6621a6d037b0 req-6f58120c-a09a-458a-a0b9-07343b58f7b5 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:17.984803 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.compute.server_external_events [req-a918555a-eaf5-41e6-9f43-6621a6d037b0 req-6f58120c-a09a-458a-a0b9-07343b58f7b5 service nova] Creating event network-vif-plugged:6e2de669-4a5d-4e6f-be74-46aa73411e81 for instance 87f86dcf-be4f-4fb9-9957-d2c5c10d999c on hv-cinder-85032 Aug 01 16:42:17.990467 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [req-a918555a-eaf5-41e6-9f43-6621a6d037b0 req-6f58120c-a09a-458a-a0b9-07343b58f7b5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049636 Aug 01 16:42:17.991428 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 228/464] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:42:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:42:18.063652 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-9ed6cbc3-2586-4d6c-903e-501865ef7504 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:18.074222 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-9ed6cbc3-2586-4d6c-903e-501865ef7504 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:18.113157 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-9ed6cbc3-2586-4d6c-903e-501865ef7504 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:18.113544 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-b81ea6f3-fd04-4543-8449-f6a2c14a2391 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:18.114042 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-9ed6cbc3-2586-4d6c-903e-501865ef7504 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:18.114482 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-9ed6cbc3-2586-4d6c-903e-501865ef7504 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:18.114610 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-b81ea6f3-fd04-4543-8449-f6a2c14a2391 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: 87f86dcf-be4f-4fb9-9957-d2c5c10d999c] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:18.114893 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-9ed6cbc3-2586-4d6c-903e-501865ef7504 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:18.131889 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-b81ea6f3-fd04-4543-8449-f6a2c14a2391 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:18.136876 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-b81ea6f3-fd04-4543-8449-f6a2c14a2391 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:18.142238 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-b81ea6f3-fd04-4543-8449-f6a2c14a2391 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:18.143839 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-b81ea6f3-fd04-4543-8449-f6a2c14a2391 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:18.544296 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-9ed6cbc3-2586-4d6c-903e-501865ef7504 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:18.570930 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-9ed6cbc3-2586-4d6c-903e-501865ef7504 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:18.573327 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-9ed6cbc3-2586-4d6c-903e-501865ef7504 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:18.574788 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-9ed6cbc3-2586-4d6c-903e-501865ef7504 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1809 microversion: 2.20 time: 0.518124 Aug 01 16:42:18.575221 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-b81ea6f3-fd04-4543-8449-f6a2c14a2391 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:18.577219 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 237/465] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:42:18 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1809 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:42:18.583881 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-b81ea6f3-fd04-4543-8449-f6a2c14a2391 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c" status: 200 len: 1371 microversion: 2.1 time: 0.476403 Aug 01 16:42:18.584965 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-d92faf3c-b536-40b6-8ab9-36c1a912b428 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:18.586553 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-d92faf3c-b536-40b6-8ab9-36c1a912b428 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] [instance: 348b2621-1bf9-431b-b639-9aabbf68a3cf] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:18.591653 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 229/466] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:42:18 2022] GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c => generated 1371 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:42:18.598393 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-d92faf3c-b536-40b6-8ab9-36c1a912b428 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:18.599114 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-d92faf3c-b536-40b6-8ab9-36c1a912b428 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:18.601183 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-d92faf3c-b536-40b6-8ab9-36c1a912b428 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:18.601882 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-d92faf3c-b536-40b6-8ab9-36c1a912b428 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:18.903985 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-d92faf3c-b536-40b6-8ab9-36c1a912b428 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a95d9f48c64b0fbb8879d361bc177d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019734069da44b2d88561549bd07544d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:18.933140 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-d92faf3c-b536-40b6-8ab9-36c1a912b428 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] 10.222.0.45 "GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf" status: 200 len: 1757 microversion: 2.1 time: 0.354091 Aug 01 16:42:18.934089 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 238/467] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:42:18 2022] GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf => generated 1757 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:42:19.620783 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-e991ddfe-82c2-40ef-9a45-f7fcade18531 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:19.621648 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-e58024eb-daf8-4724-90d0-78c8eb8811c6 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:19.622857 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-e58024eb-daf8-4724-90d0-78c8eb8811c6 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: 87f86dcf-be4f-4fb9-9957-d2c5c10d999c] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:19.623996 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-e991ddfe-82c2-40ef-9a45-f7fcade18531 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:19.639644 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-e58024eb-daf8-4724-90d0-78c8eb8811c6 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:19.644008 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-e58024eb-daf8-4724-90d0-78c8eb8811c6 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:19.651593 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-e58024eb-daf8-4724-90d0-78c8eb8811c6 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:19.653866 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-e58024eb-daf8-4724-90d0-78c8eb8811c6 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:19.675632 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-e991ddfe-82c2-40ef-9a45-f7fcade18531 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:19.684448 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-e991ddfe-82c2-40ef-9a45-f7fcade18531 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:19.686042 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-e991ddfe-82c2-40ef-9a45-f7fcade18531 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:19.686833 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-e991ddfe-82c2-40ef-9a45-f7fcade18531 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:19.966685 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-e991ddfe-82c2-40ef-9a45-f7fcade18531 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:19.998315 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-e991ddfe-82c2-40ef-9a45-f7fcade18531 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:20.006623 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-e991ddfe-82c2-40ef-9a45-f7fcade18531 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:20.012631 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-e991ddfe-82c2-40ef-9a45-f7fcade18531 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1809 microversion: 2.20 time: 0.396451 Aug 01 16:42:20.031236 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 230/468] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:42:19 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1809 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:42:20.052926 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-93b6661d-cf6d-4bdb-a62a-787a3a092640 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:20.059107 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-93b6661d-cf6d-4bdb-a62a-787a3a092640 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] [instance: 348b2621-1bf9-431b-b639-9aabbf68a3cf] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:20.089437 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-93b6661d-cf6d-4bdb-a62a-787a3a092640 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:20.090971 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-93b6661d-cf6d-4bdb-a62a-787a3a092640 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:20.095379 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-93b6661d-cf6d-4bdb-a62a-787a3a092640 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:20.110503 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-93b6661d-cf6d-4bdb-a62a-787a3a092640 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:20.252629 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-e58024eb-daf8-4724-90d0-78c8eb8811c6 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:20.283494 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-e58024eb-daf8-4724-90d0-78c8eb8811c6 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c" status: 200 len: 1371 microversion: 2.1 time: 0.667203 Aug 01 16:42:20.297540 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 239/469] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:42:19 2022] GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c => generated 1371 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:42:20.561065 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-93b6661d-cf6d-4bdb-a62a-787a3a092640 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a95d9f48c64b0fbb8879d361bc177d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019734069da44b2d88561549bd07544d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:20.573118 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-93b6661d-cf6d-4bdb-a62a-787a3a092640 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] 10.222.0.45 "GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf" status: 200 len: 1757 microversion: 2.1 time: 0.540406 Aug 01 16:42:20.590288 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 231/470] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:42:20 2022] GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf => generated 1757 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:42:21.046578 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-342f6252-139f-4be4-b36e-c0caa0adfb70 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:21.046992 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-342f6252-139f-4be4-b36e-c0caa0adfb70 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:21.054829 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-342f6252-139f-4be4-b36e-c0caa0adfb70 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:21.055298 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-342f6252-139f-4be4-b36e-c0caa0adfb70 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:21.055891 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-342f6252-139f-4be4-b36e-c0caa0adfb70 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:21.056251 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-342f6252-139f-4be4-b36e-c0caa0adfb70 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:21.243112 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-342f6252-139f-4be4-b36e-c0caa0adfb70 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:21.254999 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-342f6252-139f-4be4-b36e-c0caa0adfb70 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:21.270535 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-342f6252-139f-4be4-b36e-c0caa0adfb70 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:21.271754 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-342f6252-139f-4be4-b36e-c0caa0adfb70 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1809 microversion: 2.20 time: 0.229676 Aug 01 16:42:21.282870 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 240/471] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:42:21 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1809 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:42:21.307027 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-a844c0fe-ab44-4c8c-9add-20a236924612 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:21.307751 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-a844c0fe-ab44-4c8c-9add-20a236924612 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: 87f86dcf-be4f-4fb9-9957-d2c5c10d999c] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:21.315846 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-a844c0fe-ab44-4c8c-9add-20a236924612 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:21.316154 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-a844c0fe-ab44-4c8c-9add-20a236924612 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:21.317079 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-a844c0fe-ab44-4c8c-9add-20a236924612 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:21.317576 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-a844c0fe-ab44-4c8c-9add-20a236924612 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:21.512633 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-a844c0fe-ab44-4c8c-9add-20a236924612 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:21.525208 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-a844c0fe-ab44-4c8c-9add-20a236924612 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c" status: 200 len: 1371 microversion: 2.1 time: 0.221643 Aug 01 16:42:21.541464 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 232/472] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:42:21 2022] GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c => generated 1371 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:42:21.597674 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-9e1238c3-7087-4146-8bc3-4dc51ca4ab18 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:21.598417 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-9e1238c3-7087-4146-8bc3-4dc51ca4ab18 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] [instance: 348b2621-1bf9-431b-b639-9aabbf68a3cf] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:21.612141 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-9e1238c3-7087-4146-8bc3-4dc51ca4ab18 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:21.612687 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-9e1238c3-7087-4146-8bc3-4dc51ca4ab18 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:21.613540 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-9e1238c3-7087-4146-8bc3-4dc51ca4ab18 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:21.614048 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-9e1238c3-7087-4146-8bc3-4dc51ca4ab18 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:21.829433 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-9e1238c3-7087-4146-8bc3-4dc51ca4ab18 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a95d9f48c64b0fbb8879d361bc177d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019734069da44b2d88561549bd07544d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:21.832633 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_cell1:SELECT=100 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:42:21.852239 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-9e1238c3-7087-4146-8bc3-4dc51ca4ab18 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] 10.222.0.45 "GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf" status: 200 len: 1757 microversion: 2.1 time: 0.258681 Aug 01 16:42:21.853538 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 241/473] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:42:21 2022] GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf => generated 1757 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:42:22.300315 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-f89659d7-0e9e-4227-ae8c-af3a927d5b63 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:22.301422 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-f89659d7-0e9e-4227-ae8c-af3a927d5b63 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:22.333984 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-f89659d7-0e9e-4227-ae8c-af3a927d5b63 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:22.334748 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-f89659d7-0e9e-4227-ae8c-af3a927d5b63 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:22.335835 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-f89659d7-0e9e-4227-ae8c-af3a927d5b63 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:22.336353 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-f89659d7-0e9e-4227-ae8c-af3a927d5b63 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:22.552426 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-a1724150-4536-4da2-8c2d-25d2f7ae61df tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:22.553091 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-a1724150-4536-4da2-8c2d-25d2f7ae61df tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: 87f86dcf-be4f-4fb9-9957-d2c5c10d999c] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:22.563040 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a1724150-4536-4da2-8c2d-25d2f7ae61df tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:22.563494 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a1724150-4536-4da2-8c2d-25d2f7ae61df tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:22.564369 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a1724150-4536-4da2-8c2d-25d2f7ae61df tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:22.564759 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a1724150-4536-4da2-8c2d-25d2f7ae61df tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:22.565857 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-f89659d7-0e9e-4227-ae8c-af3a927d5b63 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:22.575402 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-f89659d7-0e9e-4227-ae8c-af3a927d5b63 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:22.578016 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-f89659d7-0e9e-4227-ae8c-af3a927d5b63 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:22.579263 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-f89659d7-0e9e-4227-ae8c-af3a927d5b63 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1809 microversion: 2.20 time: 0.284121 Aug 01 16:42:22.592185 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 233/474] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:42:22 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1809 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:42:22.808183 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-a1724150-4536-4da2-8c2d-25d2f7ae61df tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:22.828261 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-a1724150-4536-4da2-8c2d-25d2f7ae61df tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c" status: 200 len: 1371 microversion: 2.1 time: 0.267847 Aug 01 16:42:22.828948 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 242/475] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:42:22 2022] GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c => generated 1371 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:42:22.876847 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-fd1d71d7-6e39-4b8f-bcea-fa6b50c62fca tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:22.884071 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-fd1d71d7-6e39-4b8f-bcea-fa6b50c62fca tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] [instance: 348b2621-1bf9-431b-b639-9aabbf68a3cf] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:22.892802 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-fd1d71d7-6e39-4b8f-bcea-fa6b50c62fca tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:22.893773 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-fd1d71d7-6e39-4b8f-bcea-fa6b50c62fca tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:22.894856 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-fd1d71d7-6e39-4b8f-bcea-fa6b50c62fca tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:22.895626 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-fd1d71d7-6e39-4b8f-bcea-fa6b50c62fca tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:23.286397 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-fd1d71d7-6e39-4b8f-bcea-fa6b50c62fca tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a95d9f48c64b0fbb8879d361bc177d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019734069da44b2d88561549bd07544d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:23.296862 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-fd1d71d7-6e39-4b8f-bcea-fa6b50c62fca tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] 10.222.0.45 "GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf" status: 200 len: 1757 microversion: 2.1 time: 0.425827 Aug 01 16:42:23.297982 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 234/476] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:42:22 2022] GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf => generated 1757 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:42:23.608433 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-579a6bab-aee1-464f-8c05-7a93d52be42b tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:23.609784 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-579a6bab-aee1-464f-8c05-7a93d52be42b tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:23.618567 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-579a6bab-aee1-464f-8c05-7a93d52be42b tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:23.620016 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-579a6bab-aee1-464f-8c05-7a93d52be42b tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:23.621574 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-579a6bab-aee1-464f-8c05-7a93d52be42b tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:23.622425 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-579a6bab-aee1-464f-8c05-7a93d52be42b tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:23.860679 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-2c0cdb29-afb8-4718-950d-e0049789e798 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:23.863454 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-2c0cdb29-afb8-4718-950d-e0049789e798 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: 87f86dcf-be4f-4fb9-9957-d2c5c10d999c] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:23.876475 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-2c0cdb29-afb8-4718-950d-e0049789e798 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:23.877448 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-2c0cdb29-afb8-4718-950d-e0049789e798 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:23.878854 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-2c0cdb29-afb8-4718-950d-e0049789e798 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:23.880241 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-2c0cdb29-afb8-4718-950d-e0049789e798 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:23.892565 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-579a6bab-aee1-464f-8c05-7a93d52be42b tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:23.903256 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-579a6bab-aee1-464f-8c05-7a93d52be42b tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:23.906388 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-579a6bab-aee1-464f-8c05-7a93d52be42b tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:23.908263 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-579a6bab-aee1-464f-8c05-7a93d52be42b tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1809 microversion: 2.20 time: 0.304231 Aug 01 16:42:23.915822 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 243/477] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:42:23 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1809 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:42:24.137497 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-2c0cdb29-afb8-4718-950d-e0049789e798 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:24.146338 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-2c0cdb29-afb8-4718-950d-e0049789e798 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c" status: 200 len: 1371 microversion: 2.1 time: 0.291905 Aug 01 16:42:24.146988 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 235/478] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:42:23 2022] GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c => generated 1371 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:42:24.318776 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-457e8d3a-f063-4182-bd09-36e105d40d11 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:24.320226 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-457e8d3a-f063-4182-bd09-36e105d40d11 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] [instance: 348b2621-1bf9-431b-b639-9aabbf68a3cf] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:24.328454 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-457e8d3a-f063-4182-bd09-36e105d40d11 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:24.329052 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-457e8d3a-f063-4182-bd09-36e105d40d11 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:24.330076 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-457e8d3a-f063-4182-bd09-36e105d40d11 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:24.330610 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-457e8d3a-f063-4182-bd09-36e105d40d11 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:24.573180 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-457e8d3a-f063-4182-bd09-36e105d40d11 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a95d9f48c64b0fbb8879d361bc177d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019734069da44b2d88561549bd07544d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:24.582776 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-457e8d3a-f063-4182-bd09-36e105d40d11 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] 10.222.0.45 "GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf" status: 200 len: 1757 microversion: 2.1 time: 0.268007 Aug 01 16:42:24.583806 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 244/479] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:42:24 2022] GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf => generated 1757 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:42:24.934909 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-373f9bf2-7faa-49b0-a2f2-380a2c846720 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:24.946334 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-373f9bf2-7faa-49b0-a2f2-380a2c846720 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:24.961800 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-373f9bf2-7faa-49b0-a2f2-380a2c846720 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:24.962459 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-373f9bf2-7faa-49b0-a2f2-380a2c846720 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:24.963622 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-373f9bf2-7faa-49b0-a2f2-380a2c846720 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:24.964291 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-373f9bf2-7faa-49b0-a2f2-380a2c846720 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:25.146879 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-373f9bf2-7faa-49b0-a2f2-380a2c846720 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:25.164035 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-373f9bf2-7faa-49b0-a2f2-380a2c846720 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:25.165713 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-373f9bf2-7faa-49b0-a2f2-380a2c846720 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:25.167003 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-373f9bf2-7faa-49b0-a2f2-380a2c846720 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1809 microversion: 2.20 time: 0.237505 Aug 01 16:42:25.170048 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-5e998a61-54cc-4e42-8139-b06b54c6c1be tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:25.171400 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-5e998a61-54cc-4e42-8139-b06b54c6c1be tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: 87f86dcf-be4f-4fb9-9957-d2c5c10d999c] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:25.180241 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-5e998a61-54cc-4e42-8139-b06b54c6c1be tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:25.180849 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 236/480] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:42:24 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1809 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:42:25.181303 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-5e998a61-54cc-4e42-8139-b06b54c6c1be tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:25.182312 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-5e998a61-54cc-4e42-8139-b06b54c6c1be tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:25.182966 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-5e998a61-54cc-4e42-8139-b06b54c6c1be tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:25.389614 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-5e998a61-54cc-4e42-8139-b06b54c6c1be tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:25.404822 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-5e998a61-54cc-4e42-8139-b06b54c6c1be tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c" status: 200 len: 1371 microversion: 2.1 time: 0.239383 Aug 01 16:42:25.412637 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 245/481] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:42:25 2022] GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c => generated 1371 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:42:25.606110 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-54ef1d1e-d209-4c03-8be2-51435d909c76 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:25.608271 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-54ef1d1e-d209-4c03-8be2-51435d909c76 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] [instance: 348b2621-1bf9-431b-b639-9aabbf68a3cf] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:25.626506 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-54ef1d1e-d209-4c03-8be2-51435d909c76 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:25.627117 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-54ef1d1e-d209-4c03-8be2-51435d909c76 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:25.628437 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-54ef1d1e-d209-4c03-8be2-51435d909c76 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:25.629390 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-54ef1d1e-d209-4c03-8be2-51435d909c76 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:25.855814 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-54ef1d1e-d209-4c03-8be2-51435d909c76 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a95d9f48c64b0fbb8879d361bc177d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019734069da44b2d88561549bd07544d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:25.869095 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-54ef1d1e-d209-4c03-8be2-51435d909c76 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] 10.222.0.45 "GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf" status: 200 len: 1757 microversion: 2.1 time: 0.267828 Aug 01 16:42:25.869603 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 237/482] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:42:25 2022] GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf => generated 1757 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:42:26.192690 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-47adfa80-9c2f-461d-ad73-4025d66415d2 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:26.193707 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-47adfa80-9c2f-461d-ad73-4025d66415d2 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:26.207626 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-47adfa80-9c2f-461d-ad73-4025d66415d2 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:26.208165 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-47adfa80-9c2f-461d-ad73-4025d66415d2 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:26.209039 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-47adfa80-9c2f-461d-ad73-4025d66415d2 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:26.209437 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-47adfa80-9c2f-461d-ad73-4025d66415d2 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:26.434731 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-a1aff5c5-ac7a-4fe2-a428-762c0e4c97e8 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:26.436224 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-a1aff5c5-ac7a-4fe2-a428-762c0e4c97e8 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: 87f86dcf-be4f-4fb9-9957-d2c5c10d999c] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:26.447111 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-a1aff5c5-ac7a-4fe2-a428-762c0e4c97e8 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:26.450011 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-a1aff5c5-ac7a-4fe2-a428-762c0e4c97e8 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:26.452413 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-a1aff5c5-ac7a-4fe2-a428-762c0e4c97e8 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:26.458031 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-a1aff5c5-ac7a-4fe2-a428-762c0e4c97e8 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:26.481314 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-47adfa80-9c2f-461d-ad73-4025d66415d2 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:26.492019 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-47adfa80-9c2f-461d-ad73-4025d66415d2 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:26.494005 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-47adfa80-9c2f-461d-ad73-4025d66415d2 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:26.495420 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-47adfa80-9c2f-461d-ad73-4025d66415d2 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1809 microversion: 2.20 time: 0.306904 Aug 01 16:42:26.496674 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 246/483] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:42:26 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1809 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:42:26.709143 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-a1aff5c5-ac7a-4fe2-a428-762c0e4c97e8 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:26.720414 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-a1aff5c5-ac7a-4fe2-a428-762c0e4c97e8 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c" status: 200 len: 1371 microversion: 2.1 time: 0.289822 Aug 01 16:42:26.736097 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 238/484] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:42:26 2022] GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c => generated 1371 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:42:26.894439 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-92629d0b-93e1-4e6d-a3a5-f26f68ea5b2a tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:26.895692 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-92629d0b-93e1-4e6d-a3a5-f26f68ea5b2a tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] [instance: 348b2621-1bf9-431b-b639-9aabbf68a3cf] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:26.907952 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-92629d0b-93e1-4e6d-a3a5-f26f68ea5b2a tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:26.908712 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-92629d0b-93e1-4e6d-a3a5-f26f68ea5b2a tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:26.912018 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-92629d0b-93e1-4e6d-a3a5-f26f68ea5b2a tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:26.912018 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-92629d0b-93e1-4e6d-a3a5-f26f68ea5b2a tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:27.117214 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-92629d0b-93e1-4e6d-a3a5-f26f68ea5b2a tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a95d9f48c64b0fbb8879d361bc177d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019734069da44b2d88561549bd07544d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:27.126086 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-92629d0b-93e1-4e6d-a3a5-f26f68ea5b2a tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] 10.222.0.45 "GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf" status: 200 len: 1757 microversion: 2.1 time: 0.238873 Aug 01 16:42:27.127026 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 247/485] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:42:26 2022] GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf => generated 1757 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:42:27.519012 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-a82f9202-1954-4f15-b62f-7d7a8ab33964 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:27.519625 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-a82f9202-1954-4f15-b62f-7d7a8ab33964 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:27.526535 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-a82f9202-1954-4f15-b62f-7d7a8ab33964 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:27.526983 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-a82f9202-1954-4f15-b62f-7d7a8ab33964 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:27.527805 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-a82f9202-1954-4f15-b62f-7d7a8ab33964 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:27.528246 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-a82f9202-1954-4f15-b62f-7d7a8ab33964 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:27.684419 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-a82f9202-1954-4f15-b62f-7d7a8ab33964 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:27.694346 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-a82f9202-1954-4f15-b62f-7d7a8ab33964 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:27.695984 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-a82f9202-1954-4f15-b62f-7d7a8ab33964 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:27.697193 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-a82f9202-1954-4f15-b62f-7d7a8ab33964 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1809 microversion: 2.20 time: 0.182173 Aug 01 16:42:27.697744 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 239/486] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:42:27 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1809 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 16:42:27.742908 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-2b4221a6-3671-439e-802f-0cbaf386b63f tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:27.744320 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-2b4221a6-3671-439e-802f-0cbaf386b63f tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: 87f86dcf-be4f-4fb9-9957-d2c5c10d999c] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:27.753796 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-2b4221a6-3671-439e-802f-0cbaf386b63f tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:27.754550 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-2b4221a6-3671-439e-802f-0cbaf386b63f tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:27.755330 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-2b4221a6-3671-439e-802f-0cbaf386b63f tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:27.755776 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-2b4221a6-3671-439e-802f-0cbaf386b63f tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:27.904364 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-2b4221a6-3671-439e-802f-0cbaf386b63f tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:27.916368 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-2b4221a6-3671-439e-802f-0cbaf386b63f tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c" status: 200 len: 1566 microversion: 2.1 time: 0.176835 Aug 01 16:42:27.932050 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 248/487] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:42:27 2022] GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c => generated 1566 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:42:27.949697 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-cfbac8f7-4afd-40b1-9c51-f0e20b20dd19 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:27.950321 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-cfbac8f7-4afd-40b1-9c51-f0e20b20dd19 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: 87f86dcf-be4f-4fb9-9957-d2c5c10d999c] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:27.957372 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-cfbac8f7-4afd-40b1-9c51-f0e20b20dd19 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:27.957822 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-cfbac8f7-4afd-40b1-9c51-f0e20b20dd19 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:27.958595 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-cfbac8f7-4afd-40b1-9c51-f0e20b20dd19 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:27.959025 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-cfbac8f7-4afd-40b1-9c51-f0e20b20dd19 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:28.066682 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-cfbac8f7-4afd-40b1-9c51-f0e20b20dd19 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.121902 Aug 01 16:42:28.067507 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 240/488] 10.222.0.45 () {58 vars in 1275 bytes} [Mon Aug 1 16:42:27 2022] GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c/os-interface => generated 285 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:42:28.153368 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-91d509b5-e586-4144-8f41-c684cd7d190e tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:28.164120 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-91d509b5-e586-4144-8f41-c684cd7d190e tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] [instance: 348b2621-1bf9-431b-b639-9aabbf68a3cf] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:28.178452 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-91d509b5-e586-4144-8f41-c684cd7d190e tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:28.179303 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-91d509b5-e586-4144-8f41-c684cd7d190e tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:28.180492 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-91d509b5-e586-4144-8f41-c684cd7d190e tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:28.181205 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-91d509b5-e586-4144-8f41-c684cd7d190e tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:28.402520 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-91d509b5-e586-4144-8f41-c684cd7d190e tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a95d9f48c64b0fbb8879d361bc177d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019734069da44b2d88561549bd07544d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:28.413805 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-91d509b5-e586-4144-8f41-c684cd7d190e tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] 10.222.0.45 "GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf" status: 200 len: 1757 microversion: 2.1 time: 0.265075 Aug 01 16:42:28.414977 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 249/489] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:42:28 2022] GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf => generated 1757 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:42:28.722330 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-239919ee-574a-4ec6-9171-0682528ed1de tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:28.723872 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-239919ee-574a-4ec6-9171-0682528ed1de tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:28.731737 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-239919ee-574a-4ec6-9171-0682528ed1de tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:28.735843 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-239919ee-574a-4ec6-9171-0682528ed1de tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:28.735843 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-239919ee-574a-4ec6-9171-0682528ed1de tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:28.735843 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-239919ee-574a-4ec6-9171-0682528ed1de tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:28.897176 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-239919ee-574a-4ec6-9171-0682528ed1de tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:28.920386 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-239919ee-574a-4ec6-9171-0682528ed1de tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:28.926155 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-239919ee-574a-4ec6-9171-0682528ed1de tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:28.929912 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-239919ee-574a-4ec6-9171-0682528ed1de tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1809 microversion: 2.20 time: 0.211228 Aug 01 16:42:28.931944 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 241/490] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:42:28 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1809 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:42:29.368872 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [req-069c6941-7cd3-45d2-a4c7-bd6030f9c4ae req-037dee4c-b259-4dd2-8909-65bf6747ad7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87f86dcf-be4f-4fb9-9957-d2c5c10d999c", "tag": "6e2de669-4a5d-4e6f-be74-46aa73411e81"}]} {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:42:29.378202 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:42:29.385897 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-069c6941-7cd3-45d2-a4c7-bd6030f9c4ae req-037dee4c-b259-4dd2-8909-65bf6747ad7a service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:29.395056 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-069c6941-7cd3-45d2-a4c7-bd6030f9c4ae req-037dee4c-b259-4dd2-8909-65bf6747ad7a service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:29.409487 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.compute.server_external_events [req-069c6941-7cd3-45d2-a4c7-bd6030f9c4ae req-037dee4c-b259-4dd2-8909-65bf6747ad7a service nova] Creating event network-changed:6e2de669-4a5d-4e6f-be74-46aa73411e81 for instance 87f86dcf-be4f-4fb9-9957-d2c5c10d999c on hv-cinder-85032 Aug 01 16:42:29.415775 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [req-069c6941-7cd3-45d2-a4c7-bd6030f9c4ae req-037dee4c-b259-4dd2-8909-65bf6747ad7a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050518 Aug 01 16:42:29.416705 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 250/491] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:42:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:42:29.442872 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-541b5802-514f-4d48-b291-25d376d7bebd tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:29.444863 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-541b5802-514f-4d48-b291-25d376d7bebd tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] [instance: 348b2621-1bf9-431b-b639-9aabbf68a3cf] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:29.456445 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-541b5802-514f-4d48-b291-25d376d7bebd tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:29.457389 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-541b5802-514f-4d48-b291-25d376d7bebd tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:29.458671 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-541b5802-514f-4d48-b291-25d376d7bebd tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:29.460234 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-541b5802-514f-4d48-b291-25d376d7bebd tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:29.757113 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-541b5802-514f-4d48-b291-25d376d7bebd tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a95d9f48c64b0fbb8879d361bc177d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019734069da44b2d88561549bd07544d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:29.769886 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-541b5802-514f-4d48-b291-25d376d7bebd tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] 10.222.0.45 "GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf" status: 200 len: 1757 microversion: 2.1 time: 0.338228 Aug 01 16:42:29.770497 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 242/492] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:42:29 2022] GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf => generated 1757 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:42:29.961068 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-4b608c5a-218e-454e-9f9a-f926b0636d6e tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:29.962354 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-4b608c5a-218e-454e-9f9a-f926b0636d6e tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:29.972443 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-4b608c5a-218e-454e-9f9a-f926b0636d6e tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:29.973285 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-4b608c5a-218e-454e-9f9a-f926b0636d6e tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:29.974461 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-4b608c5a-218e-454e-9f9a-f926b0636d6e tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:29.975656 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-4b608c5a-218e-454e-9f9a-f926b0636d6e tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:30.229340 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-4b608c5a-218e-454e-9f9a-f926b0636d6e tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:30.238701 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-4b608c5a-218e-454e-9f9a-f926b0636d6e tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:30.240248 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-4b608c5a-218e-454e-9f9a-f926b0636d6e tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:30.241455 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-4b608c5a-218e-454e-9f9a-f926b0636d6e tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1809 microversion: 2.20 time: 0.289977 Aug 01 16:42:30.252162 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 251/493] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:42:29 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1809 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:42:30.799492 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-1157f3bd-d1e3-4906-90cb-fd42a992f89d tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:30.807469 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-1157f3bd-d1e3-4906-90cb-fd42a992f89d tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] [instance: 348b2621-1bf9-431b-b639-9aabbf68a3cf] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:30.828957 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-1157f3bd-d1e3-4906-90cb-fd42a992f89d tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:30.829807 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-1157f3bd-d1e3-4906-90cb-fd42a992f89d tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:30.830816 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-1157f3bd-d1e3-4906-90cb-fd42a992f89d tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:30.831397 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-1157f3bd-d1e3-4906-90cb-fd42a992f89d tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:31.045827 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-1157f3bd-d1e3-4906-90cb-fd42a992f89d tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a95d9f48c64b0fbb8879d361bc177d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019734069da44b2d88561549bd07544d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:31.058176 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-1157f3bd-d1e3-4906-90cb-fd42a992f89d tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] 10.222.0.45 "GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf" status: 200 len: 1757 microversion: 2.1 time: 0.269141 Aug 01 16:42:31.059095 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 243/494] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:42:30 2022] GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf => generated 1757 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:42:31.266444 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-78f49f62-e214-4807-a5a9-fd7046a49df2 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:31.267070 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-78f49f62-e214-4807-a5a9-fd7046a49df2 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:31.274213 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-78f49f62-e214-4807-a5a9-fd7046a49df2 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:31.274658 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-78f49f62-e214-4807-a5a9-fd7046a49df2 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:31.275431 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-78f49f62-e214-4807-a5a9-fd7046a49df2 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:31.275906 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-78f49f62-e214-4807-a5a9-fd7046a49df2 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:31.424223 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-78f49f62-e214-4807-a5a9-fd7046a49df2 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:31.434471 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-78f49f62-e214-4807-a5a9-fd7046a49df2 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:31.436296 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-78f49f62-e214-4807-a5a9-fd7046a49df2 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:31.437485 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-78f49f62-e214-4807-a5a9-fd7046a49df2 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1809 microversion: 2.20 time: 0.175790 Aug 01 16:42:31.438050 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 252/495] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:42:31 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1809 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:42:32.080047 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-579a443e-a7fc-413e-85f8-376769f321ff tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:32.080789 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-579a443e-a7fc-413e-85f8-376769f321ff tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] [instance: 348b2621-1bf9-431b-b639-9aabbf68a3cf] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:32.088516 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-579a443e-a7fc-413e-85f8-376769f321ff tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:32.088965 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-579a443e-a7fc-413e-85f8-376769f321ff tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:32.089813 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-579a443e-a7fc-413e-85f8-376769f321ff tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:32.090203 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-579a443e-a7fc-413e-85f8-376769f321ff tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:32.093462 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_cell1:SELECT=100 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:42:32.279234 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-579a443e-a7fc-413e-85f8-376769f321ff tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a95d9f48c64b0fbb8879d361bc177d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019734069da44b2d88561549bd07544d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:32.287942 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-579a443e-a7fc-413e-85f8-376769f321ff tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] 10.222.0.45 "GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf" status: 200 len: 1757 microversion: 2.1 time: 0.211912 Aug 01 16:42:32.288695 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 244/496] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:42:32 2022] GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf => generated 1757 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:42:32.466130 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-e43e58db-16c8-4c08-8af0-41a11f9ef4a0 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:32.467266 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-e43e58db-16c8-4c08-8af0-41a11f9ef4a0 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:32.478483 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-e43e58db-16c8-4c08-8af0-41a11f9ef4a0 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:32.479169 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-e43e58db-16c8-4c08-8af0-41a11f9ef4a0 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:32.480466 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-e43e58db-16c8-4c08-8af0-41a11f9ef4a0 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:32.481228 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-e43e58db-16c8-4c08-8af0-41a11f9ef4a0 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:32.691296 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-e43e58db-16c8-4c08-8af0-41a11f9ef4a0 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:32.701678 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-e43e58db-16c8-4c08-8af0-41a11f9ef4a0 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:32.703481 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-e43e58db-16c8-4c08-8af0-41a11f9ef4a0 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:32.705268 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-e43e58db-16c8-4c08-8af0-41a11f9ef4a0 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1809 microversion: 2.20 time: 0.246195 Aug 01 16:42:32.705934 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 253/497] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:42:32 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1809 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:42:33.312939 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-7a0d4bfa-ec11-4ac6-8e66-7d57a7f95a11 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:33.313938 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-7a0d4bfa-ec11-4ac6-8e66-7d57a7f95a11 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] [instance: 348b2621-1bf9-431b-b639-9aabbf68a3cf] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:33.321456 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-7a0d4bfa-ec11-4ac6-8e66-7d57a7f95a11 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:33.322053 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-7a0d4bfa-ec11-4ac6-8e66-7d57a7f95a11 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:33.323081 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-7a0d4bfa-ec11-4ac6-8e66-7d57a7f95a11 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:33.323560 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-7a0d4bfa-ec11-4ac6-8e66-7d57a7f95a11 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:33.488249 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-7a0d4bfa-ec11-4ac6-8e66-7d57a7f95a11 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a95d9f48c64b0fbb8879d361bc177d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019734069da44b2d88561549bd07544d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:33.496792 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-7a0d4bfa-ec11-4ac6-8e66-7d57a7f95a11 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] 10.222.0.45 "GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf" status: 200 len: 1760 microversion: 2.1 time: 0.188240 Aug 01 16:42:33.497404 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 245/498] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:42:33 2022] GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf => generated 1760 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:42:33.729007 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-3097e3df-4517-4f52-938c-512b5ef3cbc4 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:33.729780 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-3097e3df-4517-4f52-938c-512b5ef3cbc4 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:33.736198 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3097e3df-4517-4f52-938c-512b5ef3cbc4 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:33.736640 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3097e3df-4517-4f52-938c-512b5ef3cbc4 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:33.737410 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3097e3df-4517-4f52-938c-512b5ef3cbc4 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:33.737835 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3097e3df-4517-4f52-938c-512b5ef3cbc4 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:33.893267 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-3097e3df-4517-4f52-938c-512b5ef3cbc4 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:33.905563 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-3097e3df-4517-4f52-938c-512b5ef3cbc4 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:33.907137 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-3097e3df-4517-4f52-938c-512b5ef3cbc4 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:33.908386 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-3097e3df-4517-4f52-938c-512b5ef3cbc4 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1809 microversion: 2.20 time: 0.183317 Aug 01 16:42:33.909044 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 254/499] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:42:33 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1809 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:42:34.933716 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-c79ed105-4a4f-4456-9f72-fba8f8f3b047 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:34.934594 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-c79ed105-4a4f-4456-9f72-fba8f8f3b047 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:34.944681 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-c79ed105-4a4f-4456-9f72-fba8f8f3b047 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:34.945275 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-c79ed105-4a4f-4456-9f72-fba8f8f3b047 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:34.946085 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-c79ed105-4a4f-4456-9f72-fba8f8f3b047 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:34.946759 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-c79ed105-4a4f-4456-9f72-fba8f8f3b047 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:35.143964 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-c79ed105-4a4f-4456-9f72-fba8f8f3b047 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:35.159745 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-c79ed105-4a4f-4456-9f72-fba8f8f3b047 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:35.162532 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-c79ed105-4a4f-4456-9f72-fba8f8f3b047 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:35.164845 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-c79ed105-4a4f-4456-9f72-fba8f8f3b047 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1809 microversion: 2.20 time: 0.235344 Aug 01 16:42:35.166147 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 246/500] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:42:34 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1809 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:42:36.201110 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-3e1d978a-3e15-4ade-936c-9fca5fd1d58a tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:36.202334 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-3e1d978a-3e15-4ade-936c-9fca5fd1d58a tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:36.218161 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3e1d978a-3e15-4ade-936c-9fca5fd1d58a tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:36.219017 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-65721972-320e-40ba-8547-d8d014d2c3be tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:36.219890 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-65721972-320e-40ba-8547-d8d014d2c3be tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: a3f6b512-e3cb-4e87-8d82-c64f6f1640db] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:36.220308 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3e1d978a-3e15-4ade-936c-9fca5fd1d58a tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:36.222639 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3e1d978a-3e15-4ade-936c-9fca5fd1d58a tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:36.223242 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3e1d978a-3e15-4ade-936c-9fca5fd1d58a tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:36.233232 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-65721972-320e-40ba-8547-d8d014d2c3be tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:36.233958 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-65721972-320e-40ba-8547-d8d014d2c3be tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:36.235203 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-65721972-320e-40ba-8547-d8d014d2c3be tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:36.235955 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-65721972-320e-40ba-8547-d8d014d2c3be tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:36.432925 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-3e1d978a-3e15-4ade-936c-9fca5fd1d58a tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:36.450077 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-3e1d978a-3e15-4ade-936c-9fca5fd1d58a tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:36.454029 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-3e1d978a-3e15-4ade-936c-9fca5fd1d58a tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:36.456432 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-3e1d978a-3e15-4ade-936c-9fca5fd1d58a tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1809 microversion: 2.20 time: 0.261991 Aug 01 16:42:36.472967 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 255/501] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:42:36 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1809 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:42:36.479698 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.objects.instance [None req-65721972-320e-40ba-8547-d8d014d2c3be tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lazy-loading 'services' on Instance uuid a3f6b512-e3cb-4e87-8d82-c64f6f1640db {{(pid=118117) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 16:42:36.641947 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-65721972-320e-40ba-8547-d8d014d2c3be tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "DELETE /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db/os-volume_attachments/dbc5ba7d-87f8-4fd2-b18c-f03c7982ad41" status: 202 len: 0 microversion: 2.1 time: 0.429596 Aug 01 16:42:36.642705 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 247/502] 10.222.0.45 () {58 vars in 1416 bytes} [Mon Aug 1 16:42:36 2022] DELETE /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db/os-volume_attachments/dbc5ba7d-87f8-4fd2-b18c-f03c7982ad41 => generated 0 bytes in 432 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 16:42:37.495700 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-e176991b-2b2d-4f20-be98-8c4e2f2dd95f tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:37.496569 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-e176991b-2b2d-4f20-be98-8c4e2f2dd95f tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:37.506177 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-e176991b-2b2d-4f20-be98-8c4e2f2dd95f tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:37.506854 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-e176991b-2b2d-4f20-be98-8c4e2f2dd95f tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:37.508073 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-e176991b-2b2d-4f20-be98-8c4e2f2dd95f tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:37.508733 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-e176991b-2b2d-4f20-be98-8c4e2f2dd95f tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:37.700633 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-e176991b-2b2d-4f20-be98-8c4e2f2dd95f tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:37.718048 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-e176991b-2b2d-4f20-be98-8c4e2f2dd95f tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:37.721242 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-e176991b-2b2d-4f20-be98-8c4e2f2dd95f tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:37.722827 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-e176991b-2b2d-4f20-be98-8c4e2f2dd95f tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1809 microversion: 2.20 time: 0.234647 Aug 01 16:42:37.723746 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 256/503] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:42:37 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1809 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 16:42:37.999393 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [req-2d97c98a-6d5d-4f6c-82c0-5a34e0772d63 req-258807d5-8b1d-4f59-bfb0-a6cb3e7c6ce1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1c8ed71-ea21-4bca-91bf-febe7457300e", "name": "network-vif-plugged", "status": "completed", "tag": "734cefe8-e715-4af3-bebc-f135e61eb70c"}]} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:42:38.012760 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-2d97c98a-6d5d-4f6c-82c0-5a34e0772d63 req-258807d5-8b1d-4f59-bfb0-a6cb3e7c6ce1 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:38.013770 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-2d97c98a-6d5d-4f6c-82c0-5a34e0772d63 req-258807d5-8b1d-4f59-bfb0-a6cb3e7c6ce1 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:38.028786 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.compute.server_external_events [req-2d97c98a-6d5d-4f6c-82c0-5a34e0772d63 req-258807d5-8b1d-4f59-bfb0-a6cb3e7c6ce1 service nova] Creating event network-vif-plugged:734cefe8-e715-4af3-bebc-f135e61eb70c for instance f1c8ed71-ea21-4bca-91bf-febe7457300e on hv-cinder-85032 Aug 01 16:42:38.038744 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [req-2d97c98a-6d5d-4f6c-82c0-5a34e0772d63 req-258807d5-8b1d-4f59-bfb0-a6cb3e7c6ce1 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043652 Aug 01 16:42:38.040103 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 248/504] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:42:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 16:42:38.755837 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-33dd2be4-da5e-44c7-ba84-74c0ba3bb674 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:38.756933 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-33dd2be4-da5e-44c7-ba84-74c0ba3bb674 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:38.765157 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-33dd2be4-da5e-44c7-ba84-74c0ba3bb674 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:38.765644 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-33dd2be4-da5e-44c7-ba84-74c0ba3bb674 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:38.766602 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-33dd2be4-da5e-44c7-ba84-74c0ba3bb674 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:38.767035 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-33dd2be4-da5e-44c7-ba84-74c0ba3bb674 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:38.887375 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-9bc620d7-bace-49c6-b996-58b224b947b6 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:42:38.896877 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-9bc620d7-bace-49c6-b996-58b224b947b6 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:38.897439 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-9bc620d7-bace-49c6-b996-58b224b947b6 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:38.937066 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-33dd2be4-da5e-44c7-ba84-74c0ba3bb674 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:38.966253 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-33dd2be4-da5e-44c7-ba84-74c0ba3bb674 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:38.969313 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-33dd2be4-da5e-44c7-ba84-74c0ba3bb674 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:38.971948 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-33dd2be4-da5e-44c7-ba84-74c0ba3bb674 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1809 microversion: 2.20 time: 0.221677 Aug 01 16:42:38.972956 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 257/505] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:42:38 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1809 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:42:38.983127 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-9bc620d7-bace-49c6-b996-58b224b947b6 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: a3f6b512-e3cb-4e87-8d82-c64f6f1640db] Going to try to stop instance {{(pid=118117) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 01 16:42:39.047801 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-9bc620d7-bace-49c6-b996-58b224b947b6 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "POST /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db/action" status: 202 len: 0 microversion: 2.1 time: 0.165913 Aug 01 16:42:39.048644 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 249/506] 10.222.0.45 () {60 vars in 1278 bytes} [Mon Aug 1 16:42:38 2022] POST /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 01 16:42:39.059856 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-5b564273-2935-473e-9553-4ec21304ae4c tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:39.060646 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-5b564273-2935-473e-9553-4ec21304ae4c tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: a3f6b512-e3cb-4e87-8d82-c64f6f1640db] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:39.067943 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-5b564273-2935-473e-9553-4ec21304ae4c tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:39.068379 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-5b564273-2935-473e-9553-4ec21304ae4c tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:39.069165 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-5b564273-2935-473e-9553-4ec21304ae4c tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:39.069712 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-5b564273-2935-473e-9553-4ec21304ae4c tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:39.251524 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-5b564273-2935-473e-9553-4ec21304ae4c tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0aed0278344119aae6906f4f52b1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b66d46c3e7d42b88f2dbdc01232fb03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:39.261709 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-5b564273-2935-473e-9553-4ec21304ae4c tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db" status: 200 len: 1675 microversion: 2.1 time: 0.207901 Aug 01 16:42:39.262320 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 258/507] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:42:39 2022] GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db => generated 1675 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:42:40.002042 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-3e2cd0a4-479b-416a-9902-174cf10c3ec8 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:40.003392 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-3e2cd0a4-479b-416a-9902-174cf10c3ec8 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:40.005717 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_api:SELECT=62 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:42:40.015575 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-3e2cd0a4-479b-416a-9902-174cf10c3ec8 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:40.016477 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-3e2cd0a4-479b-416a-9902-174cf10c3ec8 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:40.017379 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-3e2cd0a4-479b-416a-9902-174cf10c3ec8 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:40.018273 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-3e2cd0a4-479b-416a-9902-174cf10c3ec8 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:40.198819 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-3e2cd0a4-479b-416a-9902-174cf10c3ec8 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:40.215231 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-3e2cd0a4-479b-416a-9902-174cf10c3ec8 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:40.218153 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-3e2cd0a4-479b-416a-9902-174cf10c3ec8 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:40.220304 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-3e2cd0a4-479b-416a-9902-174cf10c3ec8 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1809 microversion: 2.20 time: 0.223459 Aug 01 16:42:40.222139 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 250/508] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:42:39 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1809 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 16:42:40.286545 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-a28679c3-35c0-49b9-b09d-c5f2b175b3a7 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:40.287279 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-a28679c3-35c0-49b9-b09d-c5f2b175b3a7 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: a3f6b512-e3cb-4e87-8d82-c64f6f1640db] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:40.300140 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a28679c3-35c0-49b9-b09d-c5f2b175b3a7 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:40.300140 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a28679c3-35c0-49b9-b09d-c5f2b175b3a7 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:40.300140 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a28679c3-35c0-49b9-b09d-c5f2b175b3a7 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:40.300140 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a28679c3-35c0-49b9-b09d-c5f2b175b3a7 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:40.300811 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_cell1:SELECT=100 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:42:40.461385 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-a28679c3-35c0-49b9-b09d-c5f2b175b3a7 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0aed0278344119aae6906f4f52b1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b66d46c3e7d42b88f2dbdc01232fb03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:40.472703 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-a28679c3-35c0-49b9-b09d-c5f2b175b3a7 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db" status: 200 len: 1675 microversion: 2.1 time: 0.189981 Aug 01 16:42:40.473430 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 259/509] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:42:40 2022] GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db => generated 1675 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:42:41.262581 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-60f0c76d-8261-4756-a52d-9378906e3a82 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:41.263795 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-60f0c76d-8261-4756-a52d-9378906e3a82 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:41.274375 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-60f0c76d-8261-4756-a52d-9378906e3a82 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:41.275164 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-60f0c76d-8261-4756-a52d-9378906e3a82 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:41.276506 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-60f0c76d-8261-4756-a52d-9378906e3a82 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:41.277055 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-60f0c76d-8261-4756-a52d-9378906e3a82 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:41.457237 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-60f0c76d-8261-4756-a52d-9378906e3a82 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:41.471273 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-60f0c76d-8261-4756-a52d-9378906e3a82 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:41.473117 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-60f0c76d-8261-4756-a52d-9378906e3a82 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:41.474436 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-60f0c76d-8261-4756-a52d-9378906e3a82 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1809 microversion: 2.20 time: 0.217613 Aug 01 16:42:41.475066 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 251/510] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:42:41 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1809 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:42:41.497485 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-0486b8b0-fee8-4f4c-96d1-be02a8eef7b6 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:41.498687 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-0486b8b0-fee8-4f4c-96d1-be02a8eef7b6 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: a3f6b512-e3cb-4e87-8d82-c64f6f1640db] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:41.506192 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-0486b8b0-fee8-4f4c-96d1-be02a8eef7b6 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:41.506637 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-0486b8b0-fee8-4f4c-96d1-be02a8eef7b6 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:41.507624 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-0486b8b0-fee8-4f4c-96d1-be02a8eef7b6 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:41.508158 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-0486b8b0-fee8-4f4c-96d1-be02a8eef7b6 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:41.697630 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-0486b8b0-fee8-4f4c-96d1-be02a8eef7b6 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0aed0278344119aae6906f4f52b1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b66d46c3e7d42b88f2dbdc01232fb03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:41.707507 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-0486b8b0-fee8-4f4c-96d1-be02a8eef7b6 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db" status: 200 len: 1675 microversion: 2.1 time: 0.215591 Aug 01 16:42:41.708184 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 260/511] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:42:41 2022] GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db => generated 1675 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:42:42.500465 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-ce293072-dd6f-4281-b6aa-f0ce8f5e02ad tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:42.501480 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-ce293072-dd6f-4281-b6aa-f0ce8f5e02ad tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:42.513469 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-ce293072-dd6f-4281-b6aa-f0ce8f5e02ad tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:42.513956 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-ce293072-dd6f-4281-b6aa-f0ce8f5e02ad tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:42.514762 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-ce293072-dd6f-4281-b6aa-f0ce8f5e02ad tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:42.515220 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-ce293072-dd6f-4281-b6aa-f0ce8f5e02ad tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:42.685662 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-ce293072-dd6f-4281-b6aa-f0ce8f5e02ad tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:42.695215 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-ce293072-dd6f-4281-b6aa-f0ce8f5e02ad tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:42.696873 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-ce293072-dd6f-4281-b6aa-f0ce8f5e02ad tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:42.698160 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-ce293072-dd6f-4281-b6aa-f0ce8f5e02ad tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1796 microversion: 2.20 time: 0.202277 Aug 01 16:42:42.698726 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 252/512] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:42:42 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1796 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:42:42.732039 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-f83eb7d7-bc38-4656-982c-071040641507 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:42.732641 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-f83eb7d7-bc38-4656-982c-071040641507 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: a3f6b512-e3cb-4e87-8d82-c64f6f1640db] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:42.739201 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-f83eb7d7-bc38-4656-982c-071040641507 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:42.739647 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-f83eb7d7-bc38-4656-982c-071040641507 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:42.740486 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-f83eb7d7-bc38-4656-982c-071040641507 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:42.740914 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-f83eb7d7-bc38-4656-982c-071040641507 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:42.912338 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-f83eb7d7-bc38-4656-982c-071040641507 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0aed0278344119aae6906f4f52b1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b66d46c3e7d42b88f2dbdc01232fb03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:42.920745 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-f83eb7d7-bc38-4656-982c-071040641507 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db" status: 200 len: 1675 microversion: 2.1 time: 0.193624 Aug 01 16:42:42.921353 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 261/513] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:42:42 2022] GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db => generated 1675 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:42:43.944463 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-c13e6435-0f51-4b08-a15d-70eede77ea5c tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:43.945265 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-c13e6435-0f51-4b08-a15d-70eede77ea5c tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: a3f6b512-e3cb-4e87-8d82-c64f6f1640db] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:43.956005 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-c13e6435-0f51-4b08-a15d-70eede77ea5c tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:43.956835 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-c13e6435-0f51-4b08-a15d-70eede77ea5c tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:43.958210 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-c13e6435-0f51-4b08-a15d-70eede77ea5c tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:43.958977 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-c13e6435-0f51-4b08-a15d-70eede77ea5c tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:44.151430 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-c13e6435-0f51-4b08-a15d-70eede77ea5c tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0aed0278344119aae6906f4f52b1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b66d46c3e7d42b88f2dbdc01232fb03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:44.164986 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-c13e6435-0f51-4b08-a15d-70eede77ea5c tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db" status: 200 len: 1675 microversion: 2.1 time: 0.225620 Aug 01 16:42:44.165590 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 253/514] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:42:43 2022] GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db => generated 1675 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:42:45.189279 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-345ce254-8996-44f2-85c3-b390dfa45e02 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:45.190053 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-345ce254-8996-44f2-85c3-b390dfa45e02 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: a3f6b512-e3cb-4e87-8d82-c64f6f1640db] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:45.197060 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-345ce254-8996-44f2-85c3-b390dfa45e02 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:45.197506 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-345ce254-8996-44f2-85c3-b390dfa45e02 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:45.198286 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-345ce254-8996-44f2-85c3-b390dfa45e02 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:45.198720 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-345ce254-8996-44f2-85c3-b390dfa45e02 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:45.344852 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-345ce254-8996-44f2-85c3-b390dfa45e02 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0aed0278344119aae6906f4f52b1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b66d46c3e7d42b88f2dbdc01232fb03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:45.354187 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-345ce254-8996-44f2-85c3-b390dfa45e02 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db" status: 200 len: 1675 microversion: 2.1 time: 0.169461 Aug 01 16:42:45.354887 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 262/515] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:42:45 2022] GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db => generated 1675 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:42:46.379574 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-3c5e4a2b-4509-4690-b298-d9ec71cc6909 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:46.380181 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-3c5e4a2b-4509-4690-b298-d9ec71cc6909 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: a3f6b512-e3cb-4e87-8d82-c64f6f1640db] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:46.387832 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-3c5e4a2b-4509-4690-b298-d9ec71cc6909 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:46.388290 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-3c5e4a2b-4509-4690-b298-d9ec71cc6909 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:46.389063 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-3c5e4a2b-4509-4690-b298-d9ec71cc6909 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:46.389493 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-3c5e4a2b-4509-4690-b298-d9ec71cc6909 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:46.546476 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-3c5e4a2b-4509-4690-b298-d9ec71cc6909 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0aed0278344119aae6906f4f52b1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b66d46c3e7d42b88f2dbdc01232fb03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:46.555742 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-3c5e4a2b-4509-4690-b298-d9ec71cc6909 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db" status: 200 len: 1675 microversion: 2.1 time: 0.180112 Aug 01 16:42:46.556388 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 254/516] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:42:46 2022] GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db => generated 1675 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:42:47.579818 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-650018ad-6668-4eba-8fe1-7b1757a856a5 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:47.580514 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-650018ad-6668-4eba-8fe1-7b1757a856a5 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: a3f6b512-e3cb-4e87-8d82-c64f6f1640db] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:47.588482 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-650018ad-6668-4eba-8fe1-7b1757a856a5 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:47.589009 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-650018ad-6668-4eba-8fe1-7b1757a856a5 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:47.589739 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-650018ad-6668-4eba-8fe1-7b1757a856a5 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:47.590209 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-650018ad-6668-4eba-8fe1-7b1757a856a5 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:47.753329 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-650018ad-6668-4eba-8fe1-7b1757a856a5 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0aed0278344119aae6906f4f52b1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b66d46c3e7d42b88f2dbdc01232fb03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:47.761956 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-650018ad-6668-4eba-8fe1-7b1757a856a5 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db" status: 200 len: 1675 microversion: 2.1 time: 0.186529 Aug 01 16:42:47.762669 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 263/517] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:42:47 2022] GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db => generated 1675 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:42:48.785430 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-fe8be26e-7c3d-4cef-8e77-3cac0ddb0f25 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:48.786137 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-fe8be26e-7c3d-4cef-8e77-3cac0ddb0f25 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: a3f6b512-e3cb-4e87-8d82-c64f6f1640db] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:48.793307 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-fe8be26e-7c3d-4cef-8e77-3cac0ddb0f25 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:48.793842 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-fe8be26e-7c3d-4cef-8e77-3cac0ddb0f25 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:48.794659 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-fe8be26e-7c3d-4cef-8e77-3cac0ddb0f25 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:48.795125 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-fe8be26e-7c3d-4cef-8e77-3cac0ddb0f25 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:48.939881 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-fe8be26e-7c3d-4cef-8e77-3cac0ddb0f25 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0aed0278344119aae6906f4f52b1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b66d46c3e7d42b88f2dbdc01232fb03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:48.950455 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-fe8be26e-7c3d-4cef-8e77-3cac0ddb0f25 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db" status: 200 len: 1675 microversion: 2.1 time: 0.168513 Aug 01 16:42:48.951268 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 255/518] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:42:48 2022] GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db => generated 1675 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:42:49.975083 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-a4912398-d89c-42ec-85ad-e3bb54185c70 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:49.976038 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-a4912398-d89c-42ec-85ad-e3bb54185c70 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: a3f6b512-e3cb-4e87-8d82-c64f6f1640db] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:49.983754 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a4912398-d89c-42ec-85ad-e3bb54185c70 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:49.984235 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a4912398-d89c-42ec-85ad-e3bb54185c70 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:49.985141 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a4912398-d89c-42ec-85ad-e3bb54185c70 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:49.985614 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a4912398-d89c-42ec-85ad-e3bb54185c70 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:50.153906 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-a4912398-d89c-42ec-85ad-e3bb54185c70 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0aed0278344119aae6906f4f52b1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b66d46c3e7d42b88f2dbdc01232fb03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:50.162318 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-a4912398-d89c-42ec-85ad-e3bb54185c70 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db" status: 200 len: 1675 microversion: 2.1 time: 0.192574 Aug 01 16:42:50.162915 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 264/519] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:42:49 2022] GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db => generated 1675 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:42:50.313336 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-5e4fcfee-96cb-4a03-8987-7f4f176ef4c6 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:50.314108 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-5e4fcfee-96cb-4a03-8987-7f4f176ef4c6 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 53e1f340-623b-4453-8735-db4701fef4ad] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:50.321295 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-5e4fcfee-96cb-4a03-8987-7f4f176ef4c6 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:50.321744 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-5e4fcfee-96cb-4a03-8987-7f4f176ef4c6 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:50.322523 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-5e4fcfee-96cb-4a03-8987-7f4f176ef4c6 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:50.322955 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-5e4fcfee-96cb-4a03-8987-7f4f176ef4c6 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:50.353171 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-5e4fcfee-96cb-4a03-8987-7f4f176ef4c6 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/53e1f340-623b-4453-8735-db4701fef4ad/ips" status: 200 len: 148 microversion: 2.1 time: 0.043824 Aug 01 16:42:50.353779 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 256/520] 10.222.0.45 () {58 vars in 1248 bytes} [Mon Aug 1 16:42:50 2022] GET /compute/v2.1/servers/53e1f340-623b-4453-8735-db4701fef4ad/ips => generated 148 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:42:50.366227 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-0cc00ddb-ec9d-4570-9fe4-25eac5f60971 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "72f15c4b-9892-41ad-bfb0-687742df04c7"}} {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:42:50.368793 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-0cc00ddb-ec9d-4570-9fe4-25eac5f60971 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 53e1f340-623b-4453-8735-db4701fef4ad] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:50.376622 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-0cc00ddb-ec9d-4570-9fe4-25eac5f60971 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:50.377098 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-0cc00ddb-ec9d-4570-9fe4-25eac5f60971 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:50.377871 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-0cc00ddb-ec9d-4570-9fe4-25eac5f60971 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:50.378474 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-0cc00ddb-ec9d-4570-9fe4-25eac5f60971 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:50.463293 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.wsgi [None req-0cc00ddb-ec9d-4570-9fe4-25eac5f60971 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] HTTP exception thrown: Invalid volume: volume 72f15c4b-9892-41ad-bfb0-687742df04c7 is already attached to instances: 430702ec-add7-4d23-a875-36d09e281f0a Aug 01 16:42:50.465163 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-0cc00ddb-ec9d-4570-9fe4-25eac5f60971 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Request method failure captured: Aug 01 16:42:50.465163 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: request: POST /compute/v2.1/servers/53e1f340-623b-4453-8735-db4701fef4ad/os-volume_attachments HTTP/1.1 Aug 01 16:42:50.465163 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Accept: application/json Aug 01 16:42:50.465163 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Accept-Encoding: identity Aug 01 16:42:50.465163 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Connection: close Aug 01 16:42:50.465163 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Content-Length: 74 Aug 01 16:42:50.465163 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Content-Type: application/json Aug 01 16:42:50.465163 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Host: 10.222.0.45 Aug 01 16:42:50.465163 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Openstack-System-Scope: None Aug 01 16:42:50.465163 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: User-Agent: python-urllib3/1.26.10 Aug 01 16:42:50.465163 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Auth-Token: gAAAAABi6AHCRDGoebg0LS7gmy1eTpjTuQd112Y1pcMjujKk6txGUWSA3OMMaHc1baNi_AdoDEvdhzRnASCOKOmNH90_reDUi0PqBGMG7mNlkYUDBNxMpR2mUAgvvel08FXbCsasfVUCgx1es__sgSc1ixE0JQKf1ZzhFBiBb0upY90FvmppuN0 Aug 01 16:42:50.465163 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Domain-Id: None Aug 01 16:42:50.465163 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Domain-Name: None Aug 01 16:42:50.465163 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Identity-Status: Confirmed Aug 01 16:42:50.465163 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Is-Admin-Project: True Aug 01 16:42:50.465163 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Domain-Id: default Aug 01 16:42:50.465163 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Domain-Name: Default Aug 01 16:42:50.465163 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Id: 2f46e472f8614c5e847ceb225cc9bff1 Aug 01 16:42:50.465163 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Name: tempest-AttachVolumeNegativeTest-597514302 Aug 01 16:42:50.465163 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Role: reader,member Aug 01 16:42:50.465163 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Roles: reader,member Aug 01 16:42:50.466904 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2f46e472f8614c5e847ceb225cc9bff1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2f46e472f8614c5e847ceb225cc9bff1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2f46e472f8614c5e847ceb225cc9bff1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2f46e472f8614c5e847ceb225cc9bff1"}]}] Aug 01 16:42:50.466904 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant: tempest-AttachVolumeNegativeTest-597514302 Aug 01 16:42:50.466904 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant-Id: 2f46e472f8614c5e847ceb225cc9bff1 Aug 01 16:42:50.466904 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-597514302 Aug 01 16:42:50.466904 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User: tempest-AttachVolumeNegativeTest-597514302-project Aug 01 16:42:50.466904 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Domain-Id: default Aug 01 16:42:50.466904 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Domain-Name: Default Aug 01 16:42:50.466904 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Id: 1ac7d3acf1204a9f98f9ee14c2b46a5e Aug 01 16:42:50.466904 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Name: tempest-AttachVolumeNegativeTest-597514302-project Aug 01 16:42:50.466904 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Aug 01 16:42:50.466904 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: {"volumeAttachment": {"volumeId": "72f15c4b-9892-41ad-bfb0-687742df04c7"}} Aug 01 16:42:50.466904 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: method: > Aug 01 16:42:50.467802 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: exception: Invalid volume: volume 72f15c4b-9892-41ad-bfb0-687742df04c7 is already attached to instances: 430702ec-add7-4d23-a875-36d09e281f0a Aug 01 16:42:50.467802 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: action_args: {'server_id': '53e1f340-623b-4453-8735-db4701fef4ad', 'body': {'volumeAttachment': {'volumeId': '72f15c4b-9892-41ad-bfb0-687742df04c7'}}} Aug 01 16:42:50.467802 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:42:50.467802 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:42:50.467802 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 01 16:42:50.467802 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 01 16:42:50.467802 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 01 16:42:50.467802 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 01 16:42:50.467802 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 01 16:42:50.467802 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 01 16:42:50.467802 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 01 16:42:50.467802 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 01 16:42:50.467802 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 01 16:42:50.467802 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 01 16:42:50.467802 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 72f15c4b-9892-41ad-bfb0-687742df04c7 is already attached to instances: 430702ec-add7-4d23-a875-36d09e281f0a Aug 01 16:42:50.467802 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:42:50.467802 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:42:50.467802 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:42:50.467802 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:42:50.469443 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:42:50.469443 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:42:50.469443 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:42:50.469443 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:42:50.469443 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:42:50.469443 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:42:50.469443 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 16:42:50.469443 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 16:42:50.469443 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 16:42:50.469443 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 16:42:50.469443 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 16:42:50.469443 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 16:42:50.469443 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 01 16:42:50.469443 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 01 16:42:50.469443 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 72f15c4b-9892-41ad-bfb0-687742df04c7 is already attached to instances: 430702ec-add7-4d23-a875-36d09e281f0a Aug 01 16:42:50.469443 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:42:50.469443 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:42:50.469443 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:42:50.469443 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:42:50.469443 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:42:50.471365 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:42:50.471365 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:42:50.471365 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:42:50.471365 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 72f15c4b-9892-41ad-bfb0-687742df04c7 is already attached to instances: 430702ec-add7-4d23-a875-36d09e281f0a Aug 01 16:42:50.471365 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:42:50.471365 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-0cc00ddb-ec9d-4570-9fe4-25eac5f60971 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Returning 400 to user: Invalid volume: volume 72f15c4b-9892-41ad-bfb0-687742df04c7 is already attached to instances: 430702ec-add7-4d23-a875-36d09e281f0a {{(pid=118118) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:42:50.471365 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-0cc00ddb-ec9d-4570-9fe4-25eac5f60971 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "POST /compute/v2.1/servers/53e1f340-623b-4453-8735-db4701fef4ad/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.104765 Aug 01 16:42:50.471365 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 265/521] 10.222.0.45 () {60 vars in 1323 bytes} [Mon Aug 1 16:42:50 2022] POST /compute/v2.1/servers/53e1f340-623b-4453-8735-db4701fef4ad/os-volume_attachments => generated 174 bytes in 106 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 01 16:42:50.476453 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-06e5fc3a-515a-47d6-9d9a-b97dbf7c85c9 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:50.476894 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-06e5fc3a-515a-47d6-9d9a-b97dbf7c85c9 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 53e1f340-623b-4453-8735-db4701fef4ad] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:50.483419 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-06e5fc3a-515a-47d6-9d9a-b97dbf7c85c9 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:50.483888 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-06e5fc3a-515a-47d6-9d9a-b97dbf7c85c9 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:50.484634 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-06e5fc3a-515a-47d6-9d9a-b97dbf7c85c9 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:50.485057 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-06e5fc3a-515a-47d6-9d9a-b97dbf7c85c9 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:50.510423 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-06e5fc3a-515a-47d6-9d9a-b97dbf7c85c9 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 53e1f340-623b-4453-8735-db4701fef4ad] Going to try to terminate instance {{(pid=118117) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 16:42:50.596284 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-06e5fc3a-515a-47d6-9d9a-b97dbf7c85c9 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "DELETE /compute/v2.1/servers/53e1f340-623b-4453-8735-db4701fef4ad" status: 204 len: 0 microversion: 2.1 time: 0.122882 Aug 01 16:42:50.596885 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 257/522] 10.222.0.45 () {58 vars in 1239 bytes} [Mon Aug 1 16:42:50 2022] DELETE /compute/v2.1/servers/53e1f340-623b-4453-8735-db4701fef4ad => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 16:42:50.608888 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-0eeb7951-8953-4c3b-a4b6-9e244bcfd874 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:50.609664 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-0eeb7951-8953-4c3b-a4b6-9e244bcfd874 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 53e1f340-623b-4453-8735-db4701fef4ad] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:50.618846 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-0eeb7951-8953-4c3b-a4b6-9e244bcfd874 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:50.619603 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-0eeb7951-8953-4c3b-a4b6-9e244bcfd874 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:50.620555 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-0eeb7951-8953-4c3b-a4b6-9e244bcfd874 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:50.621050 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-0eeb7951-8953-4c3b-a4b6-9e244bcfd874 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:50.791416 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-0eeb7951-8953-4c3b-a4b6-9e244bcfd874 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac7d3acf1204a9f98f9ee14c2b46a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f46e472f8614c5e847ceb225cc9bff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:50.800972 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-0eeb7951-8953-4c3b-a4b6-9e244bcfd874 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/53e1f340-623b-4453-8735-db4701fef4ad" status: 200 len: 1679 microversion: 2.1 time: 0.197433 Aug 01 16:42:50.801536 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 266/523] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:42:50 2022] GET /compute/v2.1/servers/53e1f340-623b-4453-8735-db4701fef4ad => generated 1679 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:42:51.197318 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-2a878971-14d2-4933-9703-584bd0eed653 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:51.198035 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-2a878971-14d2-4933-9703-584bd0eed653 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: a3f6b512-e3cb-4e87-8d82-c64f6f1640db] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:51.205749 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-2a878971-14d2-4933-9703-584bd0eed653 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:51.206212 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-2a878971-14d2-4933-9703-584bd0eed653 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:51.207146 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-2a878971-14d2-4933-9703-584bd0eed653 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:51.207679 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-2a878971-14d2-4933-9703-584bd0eed653 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:51.227064 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:42:51.363477 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-2a878971-14d2-4933-9703-584bd0eed653 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0aed0278344119aae6906f4f52b1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b66d46c3e7d42b88f2dbdc01232fb03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:51.371854 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-2a878971-14d2-4933-9703-584bd0eed653 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db" status: 200 len: 1675 microversion: 2.1 time: 0.179118 Aug 01 16:42:51.372450 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 258/524] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:42:51 2022] GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db => generated 1675 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:42:51.823458 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-f7e47f93-74d0-49a3-a8f4-13c13fb2fb4e tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:51.824311 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-f7e47f93-74d0-49a3-a8f4-13c13fb2fb4e tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 53e1f340-623b-4453-8735-db4701fef4ad] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:51.832314 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-f7e47f93-74d0-49a3-a8f4-13c13fb2fb4e tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:51.832804 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-f7e47f93-74d0-49a3-a8f4-13c13fb2fb4e tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:51.833628 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-f7e47f93-74d0-49a3-a8f4-13c13fb2fb4e tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:51.834261 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-f7e47f93-74d0-49a3-a8f4-13c13fb2fb4e tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:51.976590 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-f7e47f93-74d0-49a3-a8f4-13c13fb2fb4e tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac7d3acf1204a9f98f9ee14c2b46a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f46e472f8614c5e847ceb225cc9bff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:51.986488 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-f7e47f93-74d0-49a3-a8f4-13c13fb2fb4e tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/53e1f340-623b-4453-8735-db4701fef4ad" status: 200 len: 1679 microversion: 2.1 time: 0.167351 Aug 01 16:42:51.987122 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 267/525] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:42:51 2022] GET /compute/v2.1/servers/53e1f340-623b-4453-8735-db4701fef4ad => generated 1679 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:42:52.394797 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-7db6801f-5dd7-4b10-b2f0-4c2b5171d29d tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:52.395378 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-7db6801f-5dd7-4b10-b2f0-4c2b5171d29d tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: a3f6b512-e3cb-4e87-8d82-c64f6f1640db] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:52.402271 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-7db6801f-5dd7-4b10-b2f0-4c2b5171d29d tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:52.402722 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-7db6801f-5dd7-4b10-b2f0-4c2b5171d29d tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:52.403488 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-7db6801f-5dd7-4b10-b2f0-4c2b5171d29d tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:52.403956 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-7db6801f-5dd7-4b10-b2f0-4c2b5171d29d tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:52.552392 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-7db6801f-5dd7-4b10-b2f0-4c2b5171d29d tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0aed0278344119aae6906f4f52b1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b66d46c3e7d42b88f2dbdc01232fb03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:52.560900 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-7db6801f-5dd7-4b10-b2f0-4c2b5171d29d tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db" status: 200 len: 1675 microversion: 2.1 time: 0.169899 Aug 01 16:42:52.561590 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 259/526] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:42:52 2022] GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db => generated 1675 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:42:53.019354 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-ff413610-77fc-4a92-b776-c16de37ec5a0 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:53.020267 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-ff413610-77fc-4a92-b776-c16de37ec5a0 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 53e1f340-623b-4453-8735-db4701fef4ad] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:53.028232 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-ff413610-77fc-4a92-b776-c16de37ec5a0 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:53.028720 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-ff413610-77fc-4a92-b776-c16de37ec5a0 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:53.029619 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-ff413610-77fc-4a92-b776-c16de37ec5a0 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:53.030098 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-ff413610-77fc-4a92-b776-c16de37ec5a0 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:53.585332 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-d8aa2a57-fb97-4712-a429-4f20fe69b8c2 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:53.586264 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-d8aa2a57-fb97-4712-a429-4f20fe69b8c2 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: a3f6b512-e3cb-4e87-8d82-c64f6f1640db] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:53.596093 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-ff413610-77fc-4a92-b776-c16de37ec5a0 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac7d3acf1204a9f98f9ee14c2b46a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f46e472f8614c5e847ceb225cc9bff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:53.596394 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-d8aa2a57-fb97-4712-a429-4f20fe69b8c2 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:53.596639 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-d8aa2a57-fb97-4712-a429-4f20fe69b8c2 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:53.597573 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-d8aa2a57-fb97-4712-a429-4f20fe69b8c2 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:53.598007 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-d8aa2a57-fb97-4712-a429-4f20fe69b8c2 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:53.607955 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-ff413610-77fc-4a92-b776-c16de37ec5a0 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/53e1f340-623b-4453-8735-db4701fef4ad" status: 200 len: 1679 microversion: 2.1 time: 0.593040 Aug 01 16:42:53.620257 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 268/527] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:42:53 2022] GET /compute/v2.1/servers/53e1f340-623b-4453-8735-db4701fef4ad => generated 1679 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:42:53.817360 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-d8aa2a57-fb97-4712-a429-4f20fe69b8c2 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0aed0278344119aae6906f4f52b1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b66d46c3e7d42b88f2dbdc01232fb03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:53.826161 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-d8aa2a57-fb97-4712-a429-4f20fe69b8c2 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db" status: 200 len: 1675 microversion: 2.1 time: 0.246147 Aug 01 16:42:53.826934 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 260/528] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:42:53 2022] GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db => generated 1675 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:42:54.197620 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [req-25187fac-8ec1-4059-a1da-48a46d9edc67 req-7fc430b0-9f10-45f4-8b55-43c1c1bd03df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53e1f340-623b-4453-8735-db4701fef4ad", "name": "network-vif-deleted", "tag": "d2ccad51-ab9b-4f8e-8230-cba7cac23a82"}]} {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:42:54.226304 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-25187fac-8ec1-4059-a1da-48a46d9edc67 req-7fc430b0-9f10-45f4-8b55-43c1c1bd03df service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:54.227717 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-25187fac-8ec1-4059-a1da-48a46d9edc67 req-7fc430b0-9f10-45f4-8b55-43c1c1bd03df service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:54.255026 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.compute.server_external_events [req-25187fac-8ec1-4059-a1da-48a46d9edc67 req-7fc430b0-9f10-45f4-8b55-43c1c1bd03df service nova] Creating event network-vif-deleted:d2ccad51-ab9b-4f8e-8230-cba7cac23a82 for instance 53e1f340-623b-4453-8735-db4701fef4ad on hv-cinder-85032 Aug 01 16:42:54.262244 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [req-25187fac-8ec1-4059-a1da-48a46d9edc67 req-7fc430b0-9f10-45f4-8b55-43c1c1bd03df service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072293 Aug 01 16:42:54.263699 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 269/529] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:42:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:42:54.629413 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-8dd4f189-a547-4758-8a4c-113e67f50829 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:54.630042 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-8dd4f189-a547-4758-8a4c-113e67f50829 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 53e1f340-623b-4453-8735-db4701fef4ad] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:54.637147 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-8dd4f189-a547-4758-8a4c-113e67f50829 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:54.637914 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-8dd4f189-a547-4758-8a4c-113e67f50829 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:54.638701 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-8dd4f189-a547-4758-8a4c-113e67f50829 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:54.639860 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-8dd4f189-a547-4758-8a4c-113e67f50829 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:54.675628 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-8dd4f189-a547-4758-8a4c-113e67f50829 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:54.676357 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-8dd4f189-a547-4758-8a4c-113e67f50829 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:54.676980 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.objects.instance [None req-8dd4f189-a547-4758-8a4c-113e67f50829 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lazy-loading 'fault' on Instance uuid 53e1f340-623b-4453-8735-db4701fef4ad {{(pid=118117) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 16:42:54.733003 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-8dd4f189-a547-4758-8a4c-113e67f50829 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac7d3acf1204a9f98f9ee14c2b46a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f46e472f8614c5e847ceb225cc9bff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:54.741435 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-8dd4f189-a547-4758-8a4c-113e67f50829 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/53e1f340-623b-4453-8735-db4701fef4ad" status: 200 len: 1330 microversion: 2.1 time: 0.116000 Aug 01 16:42:54.742241 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 261/530] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:42:54 2022] GET /compute/v2.1/servers/53e1f340-623b-4453-8735-db4701fef4ad => generated 1330 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:42:54.852265 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-a504473f-6dc9-44ee-8ed8-a9612622fa91 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:54.852902 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-a504473f-6dc9-44ee-8ed8-a9612622fa91 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: a3f6b512-e3cb-4e87-8d82-c64f6f1640db] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:54.860958 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a504473f-6dc9-44ee-8ed8-a9612622fa91 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:54.861403 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a504473f-6dc9-44ee-8ed8-a9612622fa91 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:54.863034 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a504473f-6dc9-44ee-8ed8-a9612622fa91 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:54.863479 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a504473f-6dc9-44ee-8ed8-a9612622fa91 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:55.047192 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-a504473f-6dc9-44ee-8ed8-a9612622fa91 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0aed0278344119aae6906f4f52b1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b66d46c3e7d42b88f2dbdc01232fb03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:55.055950 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-a504473f-6dc9-44ee-8ed8-a9612622fa91 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db" status: 200 len: 1652 microversion: 2.1 time: 0.208428 Aug 01 16:42:55.057045 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 270/531] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:42:54 2022] GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db => generated 1652 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:42:55.079782 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-83e468b9-9c45-407d-82c6-63bae17aa83f tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:42:55.088090 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-83e468b9-9c45-407d-82c6-63bae17aa83f tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:55.088815 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-83e468b9-9c45-407d-82c6-63bae17aa83f tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:55.118080 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-83e468b9-9c45-407d-82c6-63bae17aa83f tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: a3f6b512-e3cb-4e87-8d82-c64f6f1640db] Going to try to start instance {{(pid=118117) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 01 16:42:55.175362 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-83e468b9-9c45-407d-82c6-63bae17aa83f tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "POST /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db/action" status: 202 len: 0 microversion: 2.1 time: 0.096408 Aug 01 16:42:55.187518 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-c0e678d9-3f96-4009-99b4-7a2cae927eb2 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:55.188636 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-c0e678d9-3f96-4009-99b4-7a2cae927eb2 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: a3f6b512-e3cb-4e87-8d82-c64f6f1640db] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:55.191711 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 262/532] 10.222.0.45 () {60 vars in 1278 bytes} [Mon Aug 1 16:42:55 2022] POST /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 16:42:55.197180 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-c0e678d9-3f96-4009-99b4-7a2cae927eb2 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:55.197636 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-c0e678d9-3f96-4009-99b4-7a2cae927eb2 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:55.198428 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-c0e678d9-3f96-4009-99b4-7a2cae927eb2 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:55.199233 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-c0e678d9-3f96-4009-99b4-7a2cae927eb2 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:55.646568 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-c0e678d9-3f96-4009-99b4-7a2cae927eb2 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0aed0278344119aae6906f4f52b1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b66d46c3e7d42b88f2dbdc01232fb03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:55.656584 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-c0e678d9-3f96-4009-99b4-7a2cae927eb2 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db" status: 200 len: 1661 microversion: 2.1 time: 0.475259 Aug 01 16:42:55.660826 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 271/533] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:42:55 2022] GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db => generated 1661 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:42:55.767169 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-5bad8776-03df-47c7-bce0-f9b2d8acb319 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:55.768528 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-5bad8776-03df-47c7-bce0-f9b2d8acb319 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 53e1f340-623b-4453-8735-db4701fef4ad] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:55.788930 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-5bad8776-03df-47c7-bce0-f9b2d8acb319 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:55.789414 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-5bad8776-03df-47c7-bce0-f9b2d8acb319 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:55.790309 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-5bad8776-03df-47c7-bce0-f9b2d8acb319 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:55.795447 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-5bad8776-03df-47c7-bce0-f9b2d8acb319 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:55.816364 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.wsgi [None req-5bad8776-03df-47c7-bce0-f9b2d8acb319 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] HTTP exception thrown: Instance 53e1f340-623b-4453-8735-db4701fef4ad could not be found. Aug 01 16:42:55.818726 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-5bad8776-03df-47c7-bce0-f9b2d8acb319 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Request method failure captured: Aug 01 16:42:55.818726 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: request: GET /compute/v2.1/servers/53e1f340-623b-4453-8735-db4701fef4ad HTTP/1.1 Aug 01 16:42:55.818726 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Accept: application/json Aug 01 16:42:55.818726 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Accept-Encoding: identity Aug 01 16:42:55.818726 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Connection: close Aug 01 16:42:55.818726 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Content-Length: 0 Aug 01 16:42:55.818726 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Content-Type: application/json Aug 01 16:42:55.818726 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Host: 10.222.0.45 Aug 01 16:42:55.818726 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Openstack-System-Scope: None Aug 01 16:42:55.818726 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: User-Agent: python-urllib3/1.26.10 Aug 01 16:42:55.818726 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Auth-Token: gAAAAABi6AHCRDGoebg0LS7gmy1eTpjTuQd112Y1pcMjujKk6txGUWSA3OMMaHc1baNi_AdoDEvdhzRnASCOKOmNH90_reDUi0PqBGMG7mNlkYUDBNxMpR2mUAgvvel08FXbCsasfVUCgx1es__sgSc1ixE0JQKf1ZzhFBiBb0upY90FvmppuN0 Aug 01 16:42:55.818726 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Domain-Id: None Aug 01 16:42:55.818726 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Domain-Name: None Aug 01 16:42:55.818726 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Identity-Status: Confirmed Aug 01 16:42:55.818726 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Is-Admin-Project: True Aug 01 16:42:55.818726 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Domain-Id: default Aug 01 16:42:55.818726 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Domain-Name: Default Aug 01 16:42:55.818726 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Id: 2f46e472f8614c5e847ceb225cc9bff1 Aug 01 16:42:55.818726 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Name: tempest-AttachVolumeNegativeTest-597514302 Aug 01 16:42:55.818726 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Role: reader,member Aug 01 16:42:55.818726 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Roles: reader,member Aug 01 16:42:55.820441 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2f46e472f8614c5e847ceb225cc9bff1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2f46e472f8614c5e847ceb225cc9bff1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2f46e472f8614c5e847ceb225cc9bff1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2f46e472f8614c5e847ceb225cc9bff1"}]}] Aug 01 16:42:55.820441 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Tenant: tempest-AttachVolumeNegativeTest-597514302 Aug 01 16:42:55.820441 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Tenant-Id: 2f46e472f8614c5e847ceb225cc9bff1 Aug 01 16:42:55.820441 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-597514302 Aug 01 16:42:55.820441 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User: tempest-AttachVolumeNegativeTest-597514302-project Aug 01 16:42:55.820441 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Domain-Id: default Aug 01 16:42:55.820441 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Domain-Name: Default Aug 01 16:42:55.820441 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Id: 1ac7d3acf1204a9f98f9ee14c2b46a5e Aug 01 16:42:55.820441 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Name: tempest-AttachVolumeNegativeTest-597514302-project Aug 01 16:42:55.820441 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: method: > Aug 01 16:42:55.820441 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: exception: Instance 53e1f340-623b-4453-8735-db4701fef4ad could not be found. Aug 01 16:42:55.820441 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: action_args: {'id': '53e1f340-623b-4453-8735-db4701fef4ad'} Aug 01 16:42:55.821340 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:42:55.821340 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:42:55.821340 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 16:42:55.821340 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 16:42:55.821340 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 16:42:55.821340 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 16:42:55.821340 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 16:42:55.821340 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 16:42:55.821340 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 16:42:55.821340 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 16:42:55.821340 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53e1f340-623b-4453-8735-db4701fef4ad could not be found. Aug 01 16:42:55.821340 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:42:55.821340 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:42:55.821340 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:42:55.821340 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:42:55.821340 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:42:55.821340 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:42:55.821340 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:42:55.821340 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:42:55.821340 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:42:55.822778 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:42:55.822778 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 16:42:55.822778 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 16:42:55.822778 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 16:42:55.822778 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 16:42:55.822778 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 16:42:55.822778 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:42:55.822778 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53e1f340-623b-4453-8735-db4701fef4ad could not be found. Aug 01 16:42:55.822778 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:42:55.822778 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:42:55.822778 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:42:55.822778 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:42:55.822778 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:42:55.822778 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:42:55.822778 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:42:55.822778 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:42:55.822778 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53e1f340-623b-4453-8735-db4701fef4ad could not be found. Aug 01 16:42:55.822778 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:42:55.826746 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-5bad8776-03df-47c7-bce0-f9b2d8acb319 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Returning 404 to user: Instance 53e1f340-623b-4453-8735-db4701fef4ad could not be found. {{(pid=118117) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:42:55.828169 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-5bad8776-03df-47c7-bce0-f9b2d8acb319 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/53e1f340-623b-4453-8735-db4701fef4ad" status: 404 len: 111 microversion: 2.1 time: 0.067418 Aug 01 16:42:55.829289 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 263/534] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:42:55 2022] GET /compute/v2.1/servers/53e1f340-623b-4453-8735-db4701fef4ad => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 16:42:55.839622 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-74de80c7-4542-45bb-b233-05bc24a0bc4a tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '.version_select at 0x7efd5ee834c0>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:55.873024 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-74de80c7-4542-45bb-b233-05bc24a0bc4a tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-645209937" status: 202 len: 0 microversion: 2.1 time: 0.037732 Aug 01 16:42:55.879962 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 272/535] 10.222.0.45 () {58 vars in 1218 bytes} [Mon Aug 1 16:42:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-645209937 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 16:42:56.693792 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-f782752e-eba8-4573-a775-36457aec1f1f tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:56.694610 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-f782752e-eba8-4573-a775-36457aec1f1f tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: a3f6b512-e3cb-4e87-8d82-c64f6f1640db] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:56.706451 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-f782752e-eba8-4573-a775-36457aec1f1f tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:56.706929 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-f782752e-eba8-4573-a775-36457aec1f1f tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:56.708424 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-f782752e-eba8-4573-a775-36457aec1f1f tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:56.708967 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-f782752e-eba8-4573-a775-36457aec1f1f tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:56.807789 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-6aad0bb4-4787-418e-8a0c-f4a3f7ffc0e6 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:56.808529 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-6aad0bb4-4787-418e-8a0c-f4a3f7ffc0e6 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 430702ec-add7-4d23-a875-36d09e281f0a] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:56.815782 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-6aad0bb4-4787-418e-8a0c-f4a3f7ffc0e6 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:56.816303 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-6aad0bb4-4787-418e-8a0c-f4a3f7ffc0e6 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:56.817082 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-6aad0bb4-4787-418e-8a0c-f4a3f7ffc0e6 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:56.817515 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-6aad0bb4-4787-418e-8a0c-f4a3f7ffc0e6 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:56.877200 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-f782752e-eba8-4573-a775-36457aec1f1f tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0aed0278344119aae6906f4f52b1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b66d46c3e7d42b88f2dbdc01232fb03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:56.885659 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-f782752e-eba8-4573-a775-36457aec1f1f tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db" status: 200 len: 1661 microversion: 2.1 time: 0.203832 Aug 01 16:42:56.886275 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 264/536] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:42:56 2022] GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db => generated 1661 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:42:56.996270 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.objects.instance [None req-6aad0bb4-4787-418e-8a0c-f4a3f7ffc0e6 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lazy-loading 'services' on Instance uuid 430702ec-add7-4d23-a875-36d09e281f0a {{(pid=118118) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 16:42:57.145707 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-6aad0bb4-4787-418e-8a0c-f4a3f7ffc0e6 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "DELETE /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a/os-volume_attachments/72f15c4b-9892-41ad-bfb0-687742df04c7" status: 202 len: 0 microversion: 2.1 time: 0.342354 Aug 01 16:42:57.146279 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 273/537] 10.222.0.45 () {58 vars in 1416 bytes} [Mon Aug 1 16:42:56 2022] DELETE /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a/os-volume_attachments/72f15c4b-9892-41ad-bfb0-687742df04c7 => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 01 16:42:57.163956 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-1d0e33a8-f48f-4500-891a-0246733b6ed6 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:57.168566 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-1d0e33a8-f48f-4500-891a-0246733b6ed6 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 430702ec-add7-4d23-a875-36d09e281f0a] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:57.178909 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-1d0e33a8-f48f-4500-891a-0246733b6ed6 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:57.179455 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-1d0e33a8-f48f-4500-891a-0246733b6ed6 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:57.181485 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-1d0e33a8-f48f-4500-891a-0246733b6ed6 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:57.182094 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-1d0e33a8-f48f-4500-891a-0246733b6ed6 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:57.254555 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-1d0e33a8-f48f-4500-891a-0246733b6ed6 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100303 Aug 01 16:42:57.255579 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 265/538] 10.222.0.45 () {58 vars in 1302 bytes} [Mon Aug 1 16:42:57 2022] GET /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:42:57.911059 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-75afcfc1-7ddc-41f2-bbff-88195135eaf4 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:57.912174 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-75afcfc1-7ddc-41f2-bbff-88195135eaf4 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: a3f6b512-e3cb-4e87-8d82-c64f6f1640db] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:57.920568 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-75afcfc1-7ddc-41f2-bbff-88195135eaf4 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:57.921015 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-75afcfc1-7ddc-41f2-bbff-88195135eaf4 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:57.921794 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-75afcfc1-7ddc-41f2-bbff-88195135eaf4 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:57.922223 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-75afcfc1-7ddc-41f2-bbff-88195135eaf4 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:58.072480 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-75afcfc1-7ddc-41f2-bbff-88195135eaf4 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0aed0278344119aae6906f4f52b1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b66d46c3e7d42b88f2dbdc01232fb03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:42:58.085295 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-75afcfc1-7ddc-41f2-bbff-88195135eaf4 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db" status: 200 len: 1665 microversion: 2.1 time: 0.179777 Aug 01 16:42:58.086339 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 274/539] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:42:57 2022] GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db => generated 1665 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:42:58.269734 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-e3686bc5-2e03-4063-a42d-cb3f833098e1 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:58.272196 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-e3686bc5-2e03-4063-a42d-cb3f833098e1 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 430702ec-add7-4d23-a875-36d09e281f0a] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:58.280679 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-e3686bc5-2e03-4063-a42d-cb3f833098e1 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:58.281148 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-e3686bc5-2e03-4063-a42d-cb3f833098e1 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:58.281980 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-e3686bc5-2e03-4063-a42d-cb3f833098e1 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:58.282412 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-e3686bc5-2e03-4063-a42d-cb3f833098e1 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:58.317762 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-e3686bc5-2e03-4063-a42d-cb3f833098e1 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052164 Aug 01 16:42:58.318344 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 266/540] 10.222.0.45 () {58 vars in 1302 bytes} [Mon Aug 1 16:42:58 2022] GET /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:42:59.330907 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-0cc92d79-feda-42c8-a884-f70ec934f2ff tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:42:59.333213 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-0cc92d79-feda-42c8-a884-f70ec934f2ff tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 430702ec-add7-4d23-a875-36d09e281f0a] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:42:59.340001 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-0cc92d79-feda-42c8-a884-f70ec934f2ff tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:59.340537 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-0cc92d79-feda-42c8-a884-f70ec934f2ff tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:59.341328 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-0cc92d79-feda-42c8-a884-f70ec934f2ff tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:42:59.341756 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-0cc92d79-feda-42c8-a884-f70ec934f2ff tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:42:59.375592 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-0cc92d79-feda-42c8-a884-f70ec934f2ff tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048796 Aug 01 16:42:59.376243 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 275/541] 10.222.0.45 () {58 vars in 1302 bytes} [Mon Aug 1 16:42:59 2022] GET /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:43:00.389962 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-6f5ba57d-341c-4d12-98a2-24e9b49155b4 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:00.392266 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-6f5ba57d-341c-4d12-98a2-24e9b49155b4 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 430702ec-add7-4d23-a875-36d09e281f0a] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:00.400114 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-6f5ba57d-341c-4d12-98a2-24e9b49155b4 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:00.400557 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-6f5ba57d-341c-4d12-98a2-24e9b49155b4 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:00.401490 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-6f5ba57d-341c-4d12-98a2-24e9b49155b4 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:00.401937 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-6f5ba57d-341c-4d12-98a2-24e9b49155b4 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:00.440636 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-6f5ba57d-341c-4d12-98a2-24e9b49155b4 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055973 Aug 01 16:43:00.441233 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 267/542] 10.222.0.45 () {58 vars in 1302 bytes} [Mon Aug 1 16:43:00 2022] GET /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:43:01.455008 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-9c348192-1a3c-4374-a4dc-fb6a32c4fc8d tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:01.457531 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-9c348192-1a3c-4374-a4dc-fb6a32c4fc8d tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 430702ec-add7-4d23-a875-36d09e281f0a] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:01.459992 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=1 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:43:01.467370 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-9c348192-1a3c-4374-a4dc-fb6a32c4fc8d tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:01.467825 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-9c348192-1a3c-4374-a4dc-fb6a32c4fc8d tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:01.468659 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-9c348192-1a3c-4374-a4dc-fb6a32c4fc8d tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:01.469088 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-9c348192-1a3c-4374-a4dc-fb6a32c4fc8d tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:01.499660 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:43:01.508549 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-9c348192-1a3c-4374-a4dc-fb6a32c4fc8d tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059302 Aug 01 16:43:01.509153 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 276/543] 10.222.0.45 () {58 vars in 1302 bytes} [Mon Aug 1 16:43:01 2022] GET /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:43:02.525054 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-fb16fc5d-d611-46a5-ac7e-ed7fb93d8720 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:02.528169 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-fb16fc5d-d611-46a5-ac7e-ed7fb93d8720 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 430702ec-add7-4d23-a875-36d09e281f0a] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:02.535932 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-fb16fc5d-d611-46a5-ac7e-ed7fb93d8720 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:02.536384 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-fb16fc5d-d611-46a5-ac7e-ed7fb93d8720 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:02.537164 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-fb16fc5d-d611-46a5-ac7e-ed7fb93d8720 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:02.537593 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-fb16fc5d-d611-46a5-ac7e-ed7fb93d8720 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:02.569175 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-fb16fc5d-d611-46a5-ac7e-ed7fb93d8720 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050361 Aug 01 16:43:02.569723 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 268/544] 10.222.0.45 () {58 vars in 1302 bytes} [Mon Aug 1 16:43:02 2022] GET /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:43:03.582469 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-35c2f3e8-51c5-4aa4-bda1-55bdfe0ad2a8 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:03.584638 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-35c2f3e8-51c5-4aa4-bda1-55bdfe0ad2a8 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 430702ec-add7-4d23-a875-36d09e281f0a] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:03.591815 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-35c2f3e8-51c5-4aa4-bda1-55bdfe0ad2a8 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:03.592280 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-35c2f3e8-51c5-4aa4-bda1-55bdfe0ad2a8 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:03.593060 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-35c2f3e8-51c5-4aa4-bda1-55bdfe0ad2a8 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:03.593487 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-35c2f3e8-51c5-4aa4-bda1-55bdfe0ad2a8 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:03.625940 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-35c2f3e8-51c5-4aa4-bda1-55bdfe0ad2a8 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047858 Aug 01 16:43:03.626510 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 277/545] 10.222.0.45 () {58 vars in 1302 bytes} [Mon Aug 1 16:43:03 2022] GET /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:43:04.639138 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-0d8233c8-1666-40d6-bafe-08e66dd5098d tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:04.641318 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-0d8233c8-1666-40d6-bafe-08e66dd5098d tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 430702ec-add7-4d23-a875-36d09e281f0a] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:04.649707 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-0d8233c8-1666-40d6-bafe-08e66dd5098d tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:04.650231 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-0d8233c8-1666-40d6-bafe-08e66dd5098d tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:04.650989 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-0d8233c8-1666-40d6-bafe-08e66dd5098d tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:04.651428 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-0d8233c8-1666-40d6-bafe-08e66dd5098d tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:04.683087 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-0d8233c8-1666-40d6-bafe-08e66dd5098d tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048131 Aug 01 16:43:04.683715 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 269/546] 10.222.0.45 () {58 vars in 1302 bytes} [Mon Aug 1 16:43:04 2022] GET /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:43:05.695533 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-097d761e-8d25-44d6-99c5-650fbde2d70a tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:05.697699 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-097d761e-8d25-44d6-99c5-650fbde2d70a tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 430702ec-add7-4d23-a875-36d09e281f0a] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:05.704526 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-097d761e-8d25-44d6-99c5-650fbde2d70a tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:05.704975 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-097d761e-8d25-44d6-99c5-650fbde2d70a tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:05.705744 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-097d761e-8d25-44d6-99c5-650fbde2d70a tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:05.706176 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-097d761e-8d25-44d6-99c5-650fbde2d70a tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:05.742457 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-097d761e-8d25-44d6-99c5-650fbde2d70a tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050797 Aug 01 16:43:05.743199 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 278/547] 10.222.0.45 () {58 vars in 1302 bytes} [Mon Aug 1 16:43:05 2022] GET /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:43:06.756959 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-a1700287-d174-4c61-8826-910879de0913 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:06.760037 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-a1700287-d174-4c61-8826-910879de0913 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 430702ec-add7-4d23-a875-36d09e281f0a] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:06.767856 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-a1700287-d174-4c61-8826-910879de0913 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:06.768271 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-a1700287-d174-4c61-8826-910879de0913 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:06.769477 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-a1700287-d174-4c61-8826-910879de0913 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:06.769477 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-a1700287-d174-4c61-8826-910879de0913 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:06.801632 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-a1700287-d174-4c61-8826-910879de0913 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049016 Aug 01 16:43:06.802212 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 270/548] 10.222.0.45 () {58 vars in 1302 bytes} [Mon Aug 1 16:43:06 2022] GET /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:43:07.814826 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-f5feb68f-663b-4030-9138-6fbb4ce16f23 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:07.818184 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-f5feb68f-663b-4030-9138-6fbb4ce16f23 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 430702ec-add7-4d23-a875-36d09e281f0a] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:07.824994 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-f5feb68f-663b-4030-9138-6fbb4ce16f23 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:07.825895 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-f5feb68f-663b-4030-9138-6fbb4ce16f23 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:07.826936 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-f5feb68f-663b-4030-9138-6fbb4ce16f23 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:07.827612 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-f5feb68f-663b-4030-9138-6fbb4ce16f23 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:07.860833 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-f5feb68f-663b-4030-9138-6fbb4ce16f23 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050139 Aug 01 16:43:07.865473 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 279/549] 10.222.0.45 () {58 vars in 1302 bytes} [Mon Aug 1 16:43:07 2022] GET /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:43:08.875107 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-33676f7b-01d2-4452-a60d-d3eb25694386 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:08.878294 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-33676f7b-01d2-4452-a60d-d3eb25694386 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 430702ec-add7-4d23-a875-36d09e281f0a] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:08.885414 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-33676f7b-01d2-4452-a60d-d3eb25694386 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:08.885960 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-33676f7b-01d2-4452-a60d-d3eb25694386 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:08.887187 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-33676f7b-01d2-4452-a60d-d3eb25694386 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:08.888287 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-33676f7b-01d2-4452-a60d-d3eb25694386 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:08.920516 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-33676f7b-01d2-4452-a60d-d3eb25694386 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050640 Aug 01 16:43:08.927381 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 271/550] 10.222.0.45 () {58 vars in 1302 bytes} [Mon Aug 1 16:43:08 2022] GET /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 16:43:09.025320 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-2ecebb53-e847-4468-8146-f05c1fc41e56 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:09.026250 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-2ecebb53-e847-4468-8146-f05c1fc41e56 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 430702ec-add7-4d23-a875-36d09e281f0a] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:09.033775 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-2ecebb53-e847-4468-8146-f05c1fc41e56 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:09.034340 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-2ecebb53-e847-4468-8146-f05c1fc41e56 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:09.035555 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-2ecebb53-e847-4468-8146-f05c1fc41e56 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:09.036073 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-2ecebb53-e847-4468-8146-f05c1fc41e56 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:09.067465 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-2ecebb53-e847-4468-8146-f05c1fc41e56 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 430702ec-add7-4d23-a875-36d09e281f0a] Going to try to terminate instance {{(pid=118118) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 16:43:09.166255 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-2ecebb53-e847-4468-8146-f05c1fc41e56 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "DELETE /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a" status: 204 len: 0 microversion: 2.1 time: 0.144170 Aug 01 16:43:09.170941 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 280/551] 10.222.0.45 () {58 vars in 1239 bytes} [Mon Aug 1 16:43:09 2022] DELETE /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 16:43:09.176403 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-707d7971-0fe6-4bc2-bf1a-c32cdd908728 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:09.177296 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-707d7971-0fe6-4bc2-bf1a-c32cdd908728 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 430702ec-add7-4d23-a875-36d09e281f0a] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:09.188789 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-707d7971-0fe6-4bc2-bf1a-c32cdd908728 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:09.189567 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-707d7971-0fe6-4bc2-bf1a-c32cdd908728 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:09.190578 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-707d7971-0fe6-4bc2-bf1a-c32cdd908728 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:09.191212 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-707d7971-0fe6-4bc2-bf1a-c32cdd908728 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:09.344885 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-707d7971-0fe6-4bc2-bf1a-c32cdd908728 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac7d3acf1204a9f98f9ee14c2b46a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f46e472f8614c5e847ceb225cc9bff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:09.372779 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-707d7971-0fe6-4bc2-bf1a-c32cdd908728 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a" status: 200 len: 1678 microversion: 2.1 time: 0.200623 Aug 01 16:43:09.373718 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 272/552] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:43:09 2022] GET /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a => generated 1678 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:43:10.395547 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-933f96ba-d68e-446b-a6d5-70b969a21a2a tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:10.396204 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-933f96ba-d68e-446b-a6d5-70b969a21a2a tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 430702ec-add7-4d23-a875-36d09e281f0a] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:10.404760 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-933f96ba-d68e-446b-a6d5-70b969a21a2a tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:10.405210 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-933f96ba-d68e-446b-a6d5-70b969a21a2a tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:10.406007 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-933f96ba-d68e-446b-a6d5-70b969a21a2a tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:10.406439 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-933f96ba-d68e-446b-a6d5-70b969a21a2a tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:10.569743 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-933f96ba-d68e-446b-a6d5-70b969a21a2a tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac7d3acf1204a9f98f9ee14c2b46a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f46e472f8614c5e847ceb225cc9bff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:10.578593 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-933f96ba-d68e-446b-a6d5-70b969a21a2a tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a" status: 200 len: 1678 microversion: 2.1 time: 0.187279 Aug 01 16:43:10.579354 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 281/553] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:43:10 2022] GET /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a => generated 1678 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:43:11.600764 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-644182ce-79ba-445f-9b6b-5225793605ba tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:11.601333 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-644182ce-79ba-445f-9b6b-5225793605ba tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 430702ec-add7-4d23-a875-36d09e281f0a] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:11.604155 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:43:11.618412 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-644182ce-79ba-445f-9b6b-5225793605ba tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:11.618876 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-644182ce-79ba-445f-9b6b-5225793605ba tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:11.619690 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-644182ce-79ba-445f-9b6b-5225793605ba tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:11.620144 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-644182ce-79ba-445f-9b6b-5225793605ba tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:11.819568 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-644182ce-79ba-445f-9b6b-5225793605ba tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac7d3acf1204a9f98f9ee14c2b46a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f46e472f8614c5e847ceb225cc9bff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:11.837176 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-644182ce-79ba-445f-9b6b-5225793605ba tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a" status: 200 len: 1678 microversion: 2.1 time: 0.238961 Aug 01 16:43:11.851716 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 273/554] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:43:11 2022] GET /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a => generated 1678 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:43:12.405521 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [req-5b49c680-4f96-4091-90f5-6b33007bce83 req-59cce28c-3c92-4062-a29e-b5d9303125df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "430702ec-add7-4d23-a875-36d09e281f0a", "name": "network-vif-deleted", "tag": "06bd5b46-967d-4acc-87a2-ee936fcc3d78"}]} {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:43:12.422544 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-5b49c680-4f96-4091-90f5-6b33007bce83 req-59cce28c-3c92-4062-a29e-b5d9303125df service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:12.425152 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-5b49c680-4f96-4091-90f5-6b33007bce83 req-59cce28c-3c92-4062-a29e-b5d9303125df service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:12.476728 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.compute.server_external_events [req-5b49c680-4f96-4091-90f5-6b33007bce83 req-59cce28c-3c92-4062-a29e-b5d9303125df service nova] Creating event network-vif-deleted:06bd5b46-967d-4acc-87a2-ee936fcc3d78 for instance 430702ec-add7-4d23-a875-36d09e281f0a on hv-cinder-85032 Aug 01 16:43:12.484796 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [req-5b49c680-4f96-4091-90f5-6b33007bce83 req-59cce28c-3c92-4062-a29e-b5d9303125df service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082897 Aug 01 16:43:12.485870 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 282/555] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:43:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:43:12.868591 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-59fa1566-0008-4429-a034-792d77bb3420 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:12.869834 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-59fa1566-0008-4429-a034-792d77bb3420 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 430702ec-add7-4d23-a875-36d09e281f0a] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:12.899060 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-59fa1566-0008-4429-a034-792d77bb3420 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:12.899995 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-59fa1566-0008-4429-a034-792d77bb3420 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:12.900912 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-59fa1566-0008-4429-a034-792d77bb3420 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:12.901676 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-59fa1566-0008-4429-a034-792d77bb3420 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:12.932777 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:43:12.987186 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-59fa1566-0008-4429-a034-792d77bb3420 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:12.987944 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-59fa1566-0008-4429-a034-792d77bb3420 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:12.988526 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.objects.instance [None req-59fa1566-0008-4429-a034-792d77bb3420 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lazy-loading 'fault' on Instance uuid 430702ec-add7-4d23-a875-36d09e281f0a {{(pid=118117) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 16:43:13.065425 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-59fa1566-0008-4429-a034-792d77bb3420 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac7d3acf1204a9f98f9ee14c2b46a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f46e472f8614c5e847ceb225cc9bff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:13.078958 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-59fa1566-0008-4429-a034-792d77bb3420 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a" status: 200 len: 1331 microversion: 2.1 time: 0.222780 Aug 01 16:43:13.095913 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 274/556] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:43:12 2022] GET /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a => generated 1331 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:43:14.117808 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-949c0b1b-0ee7-443a-9dbb-2d6d1bb3ce8d tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:14.119860 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-949c0b1b-0ee7-443a-9dbb-2d6d1bb3ce8d tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 430702ec-add7-4d23-a875-36d09e281f0a] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:14.139229 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-949c0b1b-0ee7-443a-9dbb-2d6d1bb3ce8d tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:14.139669 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-949c0b1b-0ee7-443a-9dbb-2d6d1bb3ce8d tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:14.140716 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-949c0b1b-0ee7-443a-9dbb-2d6d1bb3ce8d tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:14.141151 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-949c0b1b-0ee7-443a-9dbb-2d6d1bb3ce8d tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:14.162429 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.wsgi [None req-949c0b1b-0ee7-443a-9dbb-2d6d1bb3ce8d tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] HTTP exception thrown: Instance 430702ec-add7-4d23-a875-36d09e281f0a could not be found. Aug 01 16:43:14.164404 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-949c0b1b-0ee7-443a-9dbb-2d6d1bb3ce8d tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Request method failure captured: Aug 01 16:43:14.164404 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: request: GET /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a HTTP/1.1 Aug 01 16:43:14.164404 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Accept: application/json Aug 01 16:43:14.164404 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Accept-Encoding: identity Aug 01 16:43:14.164404 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Connection: close Aug 01 16:43:14.164404 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Content-Length: 0 Aug 01 16:43:14.164404 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Content-Type: application/json Aug 01 16:43:14.164404 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Host: 10.222.0.45 Aug 01 16:43:14.164404 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Openstack-System-Scope: None Aug 01 16:43:14.164404 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: User-Agent: python-urllib3/1.26.10 Aug 01 16:43:14.164404 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Auth-Token: gAAAAABi6AHCRDGoebg0LS7gmy1eTpjTuQd112Y1pcMjujKk6txGUWSA3OMMaHc1baNi_AdoDEvdhzRnASCOKOmNH90_reDUi0PqBGMG7mNlkYUDBNxMpR2mUAgvvel08FXbCsasfVUCgx1es__sgSc1ixE0JQKf1ZzhFBiBb0upY90FvmppuN0 Aug 01 16:43:14.164404 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Domain-Id: None Aug 01 16:43:14.164404 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Domain-Name: None Aug 01 16:43:14.164404 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Identity-Status: Confirmed Aug 01 16:43:14.164404 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Is-Admin-Project: True Aug 01 16:43:14.164404 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Domain-Id: default Aug 01 16:43:14.164404 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Domain-Name: Default Aug 01 16:43:14.164404 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Id: 2f46e472f8614c5e847ceb225cc9bff1 Aug 01 16:43:14.164404 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Name: tempest-AttachVolumeNegativeTest-597514302 Aug 01 16:43:14.164404 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Role: reader,member Aug 01 16:43:14.164404 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Roles: reader,member Aug 01 16:43:14.165824 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2f46e472f8614c5e847ceb225cc9bff1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2f46e472f8614c5e847ceb225cc9bff1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2f46e472f8614c5e847ceb225cc9bff1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2f46e472f8614c5e847ceb225cc9bff1"}]}] Aug 01 16:43:14.165824 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant: tempest-AttachVolumeNegativeTest-597514302 Aug 01 16:43:14.165824 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant-Id: 2f46e472f8614c5e847ceb225cc9bff1 Aug 01 16:43:14.165824 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-597514302 Aug 01 16:43:14.165824 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User: tempest-AttachVolumeNegativeTest-597514302-project Aug 01 16:43:14.165824 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Domain-Id: default Aug 01 16:43:14.165824 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Domain-Name: Default Aug 01 16:43:14.165824 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Id: 1ac7d3acf1204a9f98f9ee14c2b46a5e Aug 01 16:43:14.165824 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Name: tempest-AttachVolumeNegativeTest-597514302-project Aug 01 16:43:14.165824 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: method: > Aug 01 16:43:14.165824 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: exception: Instance 430702ec-add7-4d23-a875-36d09e281f0a could not be found. Aug 01 16:43:14.165824 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: action_args: {'id': '430702ec-add7-4d23-a875-36d09e281f0a'} Aug 01 16:43:14.171015 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:43:14.171015 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:43:14.171015 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 16:43:14.171015 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 16:43:14.171015 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 16:43:14.171015 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 16:43:14.171015 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 16:43:14.171015 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 16:43:14.171015 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 16:43:14.171015 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 16:43:14.171015 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 430702ec-add7-4d23-a875-36d09e281f0a could not be found. Aug 01 16:43:14.171015 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:43:14.171015 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:43:14.171015 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:43:14.171015 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:43:14.171015 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:43:14.171015 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:43:14.171015 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:43:14.171015 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:43:14.171015 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:43:14.172561 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:43:14.172561 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 16:43:14.172561 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 16:43:14.172561 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 16:43:14.172561 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 16:43:14.172561 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 16:43:14.172561 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:43:14.172561 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 430702ec-add7-4d23-a875-36d09e281f0a could not be found. Aug 01 16:43:14.172561 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:43:14.172561 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:43:14.172561 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:43:14.172561 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:43:14.172561 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:43:14.172561 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:43:14.172561 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:43:14.172561 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:43:14.172561 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 430702ec-add7-4d23-a875-36d09e281f0a could not be found. Aug 01 16:43:14.172561 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:43:14.175181 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-949c0b1b-0ee7-443a-9dbb-2d6d1bb3ce8d tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Returning 404 to user: Instance 430702ec-add7-4d23-a875-36d09e281f0a could not be found. {{(pid=118118) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:43:14.175181 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-949c0b1b-0ee7-443a-9dbb-2d6d1bb3ce8d tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a" status: 404 len: 111 microversion: 2.1 time: 0.066030 Aug 01 16:43:14.175181 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 283/557] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:43:14 2022] GET /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 16:43:14.175600 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-5fbf7a38-3f17-4e32-b610-b6a6719b375e tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '.version_select at 0x7efd5eaf1ca0>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:14.206118 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-5fbf7a38-3f17-4e32-b610-b6a6719b375e tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-282676080" status: 202 len: 0 microversion: 2.1 time: 0.034366 Aug 01 16:43:14.207018 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 275/558] 10.222.0.45 () {58 vars in 1218 bytes} [Mon Aug 1 16:43:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-282676080 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 16:43:14.990544 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-c6091d2c-b0df-48fc-8e46-bf1948a0e000 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Action: 'create', calling method: .version_select at 0x7efd5ec800d0>, body: {"keypair": {"name": "tempest-keypair-1225354786", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBf3IlZ/3d6mj1GqzQ/lnKZ/mubpZbA2H4MdRQKG8YShMS9I/Qg+H5wcdy+vHeDdyUHlefOZiIAvADXNQrMp8uFCyoVaDm5+Zx4W1BTprAeMlvjY2fr2X14w99Q6kmuTVA=="}} {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:43:15.009387 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.quota [None req-c6091d2c-b0df-48fc-8e46-bf1948a0e000 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Getting quotas for project 2f46e472f8614c5e847ceb225cc9bff1. Resources: {'key_pairs'} {{(pid=118118) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 16:43:15.014760 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.quota [None req-c6091d2c-b0df-48fc-8e46-bf1948a0e000 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Getting quotas for user 1ac7d3acf1204a9f98f9ee14c2b46a5e and project 2f46e472f8614c5e847ceb225cc9bff1. Resources: {'key_pairs'} {{(pid=118118) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 16:43:15.045434 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-c6091d2c-b0df-48fc-8e46-bf1948a0e000 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.059845 Aug 01 16:43:15.052564 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 284/559] 10.222.0.45 () {60 vars in 1159 bytes} [Mon Aug 1 16:43:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:43:16.625258 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-7de6b187-ff49-4883-a56b-9d72df290b1a tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fd05abf8-7d80-4794-aea2-328213fe337b"}} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:43:16.650904 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-7de6b187-ff49-4883-a56b-9d72df290b1a tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: 87f86dcf-be4f-4fb9-9957-d2c5c10d999c] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:16.671854 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-7de6b187-ff49-4883-a56b-9d72df290b1a tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:16.680722 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-7de6b187-ff49-4883-a56b-9d72df290b1a tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:16.681788 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-7de6b187-ff49-4883-a56b-9d72df290b1a tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:16.682393 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-7de6b187-ff49-4883-a56b-9d72df290b1a tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:17.164623 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-7de6b187-ff49-4883-a56b-9d72df290b1a tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "POST /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.548060 Aug 01 16:43:17.167076 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 276/560] 10.222.0.45 () {60 vars in 1323 bytes} [Mon Aug 1 16:43:16 2022] POST /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c/os-volume_attachments => generated 194 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:43:17.320523 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-22fc562e-2f85-4841-92ce-e73b61ae00ed tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-871179597", "imageRef": "c9cb5329-85cb-4472-935d-c4ea1d1f0592", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "94e169bb-9307-4057-852a-5a9a3345875b"}], "security_groups": [{"name": "tempest-securitygroup--1266461967"}], "key_name": "tempest-keypair-1225354786", "user_data": "}} {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:43:17.568895 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.network.neutron [None req-22fc562e-2f85-4841-92ce-e73b61ae00ed tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] validate_networks() for [('94e169bb-9307-4057-852a-5a9a3345875b', None, None, None, None, None)] {{(pid=118118) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 16:43:18.551442 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.virt.hardware [None req-22fc562e-2f85-4841-92ce-e73b61ae00ed tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Flavor limits 0:0:0 {{(pid=118118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 16:43:18.552159 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.virt.hardware [None req-22fc562e-2f85-4841-92ce-e73b61ae00ed tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Image limits 0:0:0 {{(pid=118118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 16:43:18.553058 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.virt.hardware [None req-22fc562e-2f85-4841-92ce-e73b61ae00ed tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Flavor pref 0:0:0 {{(pid=118118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 16:43:18.553515 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.virt.hardware [None req-22fc562e-2f85-4841-92ce-e73b61ae00ed tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Image pref 0:0:0 {{(pid=118118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 16:43:18.554006 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.virt.hardware [None req-22fc562e-2f85-4841-92ce-e73b61ae00ed tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 16:43:18.568869 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-22fc562e-2f85-4841-92ce-e73b61ae00ed tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:18.569549 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-22fc562e-2f85-4841-92ce-e73b61ae00ed tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:18.571034 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-22fc562e-2f85-4841-92ce-e73b61ae00ed tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:18.571477 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-22fc562e-2f85-4841-92ce-e73b61ae00ed tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:18.597676 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.quota [None req-22fc562e-2f85-4841-92ce-e73b61ae00ed tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Getting quotas for project 2f46e472f8614c5e847ceb225cc9bff1. Resources: {'cores', 'ram', 'instances'} {{(pid=118118) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 16:43:18.604345 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.quota [None req-22fc562e-2f85-4841-92ce-e73b61ae00ed tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Getting quotas for user 1ac7d3acf1204a9f98f9ee14c2b46a5e and project 2f46e472f8614c5e847ceb225cc9bff1. Resources: {'cores', 'ram', 'instances'} {{(pid=118118) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 16:43:18.617945 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-22fc562e-2f85-4841-92ce-e73b61ae00ed tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Going to run 1 instances... {{(pid=118118) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 16:43:18.627079 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-22fc562e-2f85-4841-92ce-e73b61ae00ed tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 8ad215fb-dc14-4768-98d9-c57389e0d317] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c9cb5329-85cb-4472-935d-c4ea1d1f0592',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118118) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 16:43:18.681625 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-22fc562e-2f85-4841-92ce-e73b61ae00ed tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.366771 Aug 01 16:43:18.682274 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 285/561] 10.222.0.45 () {60 vars in 1147 bytes} [Mon Aug 1 16:43:17 2022] POST /compute/v2.1/servers => generated 402 bytes in 1368 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 16:43:18.695838 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-fc3d51cb-0ebc-4a9b-aa16-280e73c497fb tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:18.701458 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-fc3d51cb-0ebc-4a9b-aa16-280e73c497fb tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 8ad215fb-dc14-4768-98d9-c57389e0d317] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:18.799668 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-fc3d51cb-0ebc-4a9b-aa16-280e73c497fb tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac7d3acf1204a9f98f9ee14c2b46a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f46e472f8614c5e847ceb225cc9bff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:18.812643 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-fc3d51cb-0ebc-4a9b-aa16-280e73c497fb tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/8ad215fb-dc14-4768-98d9-c57389e0d317" status: 200 len: 1241 microversion: 2.1 time: 0.121272 Aug 01 16:43:18.827707 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 277/562] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:43:18 2022] GET /compute/v2.1/servers/8ad215fb-dc14-4768-98d9-c57389e0d317 => generated 1241 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:43:19.408204 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-9822af46-e382-4406-9d51-1b0dda0388ca tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Action: 'create', calling method: .version_select at 0x7efd5ec80ee0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1173141553", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKiscWqhKF1FQKO6Zc+Y+BPRMvBQtkrMjgxkEN1yhjGtwZPHQxEeWWDymn5RnHdRYhXSNkPOFETEDHzCrMIJlWvSuNmxH+n702lyZr635015oG3/GAoqVp5TvV5T8eGDVQ=="}} {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:43:19.441559 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.quota [None req-9822af46-e382-4406-9d51-1b0dda0388ca tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Getting quotas for project c86fcc5e23854dfba97058deac8211d0. Resources: {'key_pairs'} {{(pid=118118) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 16:43:19.460126 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.quota [None req-9822af46-e382-4406-9d51-1b0dda0388ca tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Getting quotas for user 22cfd17a6f434deca7ef77253ae3ed2f and project c86fcc5e23854dfba97058deac8211d0. Resources: {'key_pairs'} {{(pid=118118) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 16:43:19.513851 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-9822af46-e382-4406-9d51-1b0dda0388ca tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.331431 Aug 01 16:43:19.515156 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 286/563] 10.222.0.45 () {60 vars in 1159 bytes} [Mon Aug 1 16:43:19 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:43:19.835437 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-fd5e648a-e63b-4125-ab29-ab9edee116ea tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:19.836116 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-fd5e648a-e63b-4125-ab29-ab9edee116ea tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 8ad215fb-dc14-4768-98d9-c57389e0d317] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:19.850110 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-fd5e648a-e63b-4125-ab29-ab9edee116ea tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:19.850648 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-fd5e648a-e63b-4125-ab29-ab9edee116ea tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:19.857158 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-fd5e648a-e63b-4125-ab29-ab9edee116ea tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:19.857894 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-fd5e648a-e63b-4125-ab29-ab9edee116ea tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:20.007831 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-fd5e648a-e63b-4125-ab29-ab9edee116ea tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac7d3acf1204a9f98f9ee14c2b46a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f46e472f8614c5e847ceb225cc9bff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:20.016586 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-fd5e648a-e63b-4125-ab29-ab9edee116ea tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/8ad215fb-dc14-4768-98d9-c57389e0d317" status: 200 len: 1293 microversion: 2.1 time: 0.185561 Aug 01 16:43:20.031907 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 278/564] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:43:19 2022] GET /compute/v2.1/servers/8ad215fb-dc14-4768-98d9-c57389e0d317 => generated 1293 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:43:21.054809 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-70fd55f3-782a-4a4d-b08d-cd7c8753e129 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:21.055485 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-70fd55f3-782a-4a4d-b08d-cd7c8753e129 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 8ad215fb-dc14-4768-98d9-c57389e0d317] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:21.071113 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-70fd55f3-782a-4a4d-b08d-cd7c8753e129 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:21.071566 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-70fd55f3-782a-4a4d-b08d-cd7c8753e129 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:21.072426 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-70fd55f3-782a-4a4d-b08d-cd7c8753e129 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:21.072912 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-70fd55f3-782a-4a4d-b08d-cd7c8753e129 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:21.317713 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-70fd55f3-782a-4a4d-b08d-cd7c8753e129 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac7d3acf1204a9f98f9ee14c2b46a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f46e472f8614c5e847ceb225cc9bff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:21.332074 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-70fd55f3-782a-4a4d-b08d-cd7c8753e129 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/8ad215fb-dc14-4768-98d9-c57389e0d317" status: 200 len: 1367 microversion: 2.1 time: 0.281281 Aug 01 16:43:21.332675 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 287/565] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:43:21 2022] GET /compute/v2.1/servers/8ad215fb-dc14-4768-98d9-c57389e0d317 => generated 1367 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:43:22.138736 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [req-96a649fe-84b5-4841-89c0-99803d613044 req-512d7acc-c714-46bd-9ed1-dd2a2d3d2edb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ad215fb-dc14-4768-98d9-c57389e0d317", "tag": "b4171be2-3d4a-4e8a-84b5-cd3bda91a4c0"}]} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:43:22.150325 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-96a649fe-84b5-4841-89c0-99803d613044 req-512d7acc-c714-46bd-9ed1-dd2a2d3d2edb service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:22.151255 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-96a649fe-84b5-4841-89c0-99803d613044 req-512d7acc-c714-46bd-9ed1-dd2a2d3d2edb service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:22.184686 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.compute.server_external_events [req-96a649fe-84b5-4841-89c0-99803d613044 req-512d7acc-c714-46bd-9ed1-dd2a2d3d2edb service nova] Creating event network-changed:b4171be2-3d4a-4e8a-84b5-cd3bda91a4c0 for instance 8ad215fb-dc14-4768-98d9-c57389e0d317 on hv-cinder-85032 Aug 01 16:43:22.191125 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [req-96a649fe-84b5-4841-89c0-99803d613044 req-512d7acc-c714-46bd-9ed1-dd2a2d3d2edb service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056430 Aug 01 16:43:22.191852 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 279/566] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:43:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:43:22.361492 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-5e153747-b88e-4ee5-9d77-f4196f7b2155 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:22.362759 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-5e153747-b88e-4ee5-9d77-f4196f7b2155 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 8ad215fb-dc14-4768-98d9-c57389e0d317] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:22.371057 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-5e153747-b88e-4ee5-9d77-f4196f7b2155 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:22.371514 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-5e153747-b88e-4ee5-9d77-f4196f7b2155 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:22.372352 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-5e153747-b88e-4ee5-9d77-f4196f7b2155 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:22.372935 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-5e153747-b88e-4ee5-9d77-f4196f7b2155 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:22.658657 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-5e153747-b88e-4ee5-9d77-f4196f7b2155 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac7d3acf1204a9f98f9ee14c2b46a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f46e472f8614c5e847ceb225cc9bff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:22.685797 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-5e153747-b88e-4ee5-9d77-f4196f7b2155 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/8ad215fb-dc14-4768-98d9-c57389e0d317" status: 200 len: 1367 microversion: 2.1 time: 0.313228 Aug 01 16:43:22.686148 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 288/567] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:43:22 2022] GET /compute/v2.1/servers/8ad215fb-dc14-4768-98d9-c57389e0d317 => generated 1367 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:43:23.710754 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-df68abba-460e-4b71-b08c-f57c483adf4a tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:23.712005 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-df68abba-460e-4b71-b08c-f57c483adf4a tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 8ad215fb-dc14-4768-98d9-c57389e0d317] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:23.725400 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-df68abba-460e-4b71-b08c-f57c483adf4a tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:23.726327 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-df68abba-460e-4b71-b08c-f57c483adf4a tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:23.727497 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-df68abba-460e-4b71-b08c-f57c483adf4a tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:23.728166 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-df68abba-460e-4b71-b08c-f57c483adf4a tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:23.976058 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-df68abba-460e-4b71-b08c-f57c483adf4a tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac7d3acf1204a9f98f9ee14c2b46a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f46e472f8614c5e847ceb225cc9bff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:23.995415 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-df68abba-460e-4b71-b08c-f57c483adf4a tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/8ad215fb-dc14-4768-98d9-c57389e0d317" status: 200 len: 1367 microversion: 2.1 time: 0.291723 Aug 01 16:43:23.996026 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 280/568] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:43:23 2022] GET /compute/v2.1/servers/8ad215fb-dc14-4768-98d9-c57389e0d317 => generated 1367 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:43:24.862294 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-42f8de09-b33b-49d2-ac0b-231d8624cf45 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1013811994"}} {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:43:24.863200 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-42f8de09-b33b-49d2-ac0b-231d8624cf45 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] [instance: 348b2621-1bf9-431b-b639-9aabbf68a3cf] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:24.874846 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-42f8de09-b33b-49d2-ac0b-231d8624cf45 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:24.876922 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-42f8de09-b33b-49d2-ac0b-231d8624cf45 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:24.878433 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-42f8de09-b33b-49d2-ac0b-231d8624cf45 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:24.879127 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-42f8de09-b33b-49d2-ac0b-231d8624cf45 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:25.033775 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-1e56cfbb-a0be-429c-afd8-0d4cf587016d tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:25.034826 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-1e56cfbb-a0be-429c-afd8-0d4cf587016d tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 8ad215fb-dc14-4768-98d9-c57389e0d317] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:25.043452 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-1e56cfbb-a0be-429c-afd8-0d4cf587016d tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:25.044029 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-1e56cfbb-a0be-429c-afd8-0d4cf587016d tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:25.044856 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-1e56cfbb-a0be-429c-afd8-0d4cf587016d tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:25.045294 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-1e56cfbb-a0be-429c-afd8-0d4cf587016d tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:25.222860 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.network.security_group_api [None req-42f8de09-b33b-49d2-ac0b-231d8624cf45 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Removing security group 7a825f82-e0e8-47f2-8dae-f903565c61ce from port 8967f796-0a7a-4c6f-b2f7-18a05072b7c4 Aug 01 16:43:25.470655 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-1e56cfbb-a0be-429c-afd8-0d4cf587016d tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac7d3acf1204a9f98f9ee14c2b46a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f46e472f8614c5e847ceb225cc9bff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:25.483683 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-1e56cfbb-a0be-429c-afd8-0d4cf587016d tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/8ad215fb-dc14-4768-98d9-c57389e0d317" status: 200 len: 1367 microversion: 2.1 time: 0.453886 Aug 01 16:43:25.496185 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 281/569] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:43:25 2022] GET /compute/v2.1/servers/8ad215fb-dc14-4768-98d9-c57389e0d317 => generated 1367 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:43:25.818702 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-42f8de09-b33b-49d2-ac0b-231d8624cf45 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] 10.222.0.45 "POST /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf/action" status: 202 len: 0 microversion: 2.1 time: 0.963736 Aug 01 16:43:25.827168 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 289/570] 10.222.0.45 () {60 vars in 1278 bytes} [Mon Aug 1 16:43:24 2022] POST /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf/action => generated 0 bytes in 974 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 16:43:25.833896 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [req-e0ae4499-0063-48d6-8b36-ad0dc9e5fdfa req-b8ba9504-a9be-46c7-a89e-69fe8bf92082 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "348b2621-1bf9-431b-b639-9aabbf68a3cf", "tag": "8967f796-0a7a-4c6f-b2f7-18a05072b7c4"}]} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:43:25.847359 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-e0ae4499-0063-48d6-8b36-ad0dc9e5fdfa req-b8ba9504-a9be-46c7-a89e-69fe8bf92082 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:25.848285 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-e0ae4499-0063-48d6-8b36-ad0dc9e5fdfa req-b8ba9504-a9be-46c7-a89e-69fe8bf92082 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:25.863341 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.compute.server_external_events [req-e0ae4499-0063-48d6-8b36-ad0dc9e5fdfa req-b8ba9504-a9be-46c7-a89e-69fe8bf92082 service nova] Creating event network-changed:8967f796-0a7a-4c6f-b2f7-18a05072b7c4 for instance 348b2621-1bf9-431b-b639-9aabbf68a3cf on hv-cinder-85032 Aug 01 16:43:25.869445 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [req-e0ae4499-0063-48d6-8b36-ad0dc9e5fdfa req-b8ba9504-a9be-46c7-a89e-69fe8bf92082 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041689 Aug 01 16:43:25.870508 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 282/571] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:43:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 16:43:26.284033 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-525aafc6-9adc-4933-9108-14bf49108340 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:43:26.286818 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-525aafc6-9adc-4933-9108-14bf49108340 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: 87f86dcf-be4f-4fb9-9957-d2c5c10d999c] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:26.298652 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-525aafc6-9adc-4933-9108-14bf49108340 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:26.299558 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-525aafc6-9adc-4933-9108-14bf49108340 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:26.300526 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-525aafc6-9adc-4933-9108-14bf49108340 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:26.301046 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-525aafc6-9adc-4933-9108-14bf49108340 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:26.330268 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.objects.instance [None req-525aafc6-9adc-4933-9108-14bf49108340 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lazy-loading 'flavor' on Instance uuid 87f86dcf-be4f-4fb9-9957-d2c5c10d999c {{(pid=118118) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 16:43:26.527595 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-13ac80f1-c7e0-4ddf-954d-7d005147a539 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:26.528815 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-525aafc6-9adc-4933-9108-14bf49108340 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "POST /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c/action" status: 200 len: 32 microversion: 2.1 time: 0.252030 Aug 01 16:43:26.533518 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-13ac80f1-c7e0-4ddf-954d-7d005147a539 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 8ad215fb-dc14-4768-98d9-c57389e0d317] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:26.534025 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 290/572] 10.222.0.45 () {60 vars in 1278 bytes} [Mon Aug 1 16:43:26 2022] POST /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c/action => generated 32 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 01 16:43:26.541691 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-94177e26-c257-476a-be8a-5d6c3b032539 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:26.550494 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-94177e26-c257-476a-be8a-5d6c3b032539 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: 87f86dcf-be4f-4fb9-9957-d2c5c10d999c] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:26.559425 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-13ac80f1-c7e0-4ddf-954d-7d005147a539 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:26.560614 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-13ac80f1-c7e0-4ddf-954d-7d005147a539 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:26.562207 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-13ac80f1-c7e0-4ddf-954d-7d005147a539 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:26.562982 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-13ac80f1-c7e0-4ddf-954d-7d005147a539 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:26.575516 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-94177e26-c257-476a-be8a-5d6c3b032539 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:26.576122 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-94177e26-c257-476a-be8a-5d6c3b032539 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:26.577131 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-94177e26-c257-476a-be8a-5d6c3b032539 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:26.577805 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-94177e26-c257-476a-be8a-5d6c3b032539 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:27.408128 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-13ac80f1-c7e0-4ddf-954d-7d005147a539 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac7d3acf1204a9f98f9ee14c2b46a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f46e472f8614c5e847ceb225cc9bff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:27.417181 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-94177e26-c257-476a-be8a-5d6c3b032539 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:27.417878 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-13ac80f1-c7e0-4ddf-954d-7d005147a539 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/8ad215fb-dc14-4768-98d9-c57389e0d317" status: 200 len: 1367 microversion: 2.1 time: 0.900532 Aug 01 16:43:27.421714 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 283/573] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:43:26 2022] GET /compute/v2.1/servers/8ad215fb-dc14-4768-98d9-c57389e0d317 => generated 1367 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:43:27.433423 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-94177e26-c257-476a-be8a-5d6c3b032539 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c" status: 200 len: 1737 microversion: 2.1 time: 0.896104 Aug 01 16:43:27.434188 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 291/574] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:43:26 2022] GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c => generated 1737 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:43:27.436143 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [req-037f7aae-8a24-48a0-a211-e0b6691732bb req-be11885e-7db7-48b0-b646-491085175911 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ad215fb-dc14-4768-98d9-c57389e0d317", "name": "network-vif-plugged", "status": "completed", "tag": "b4171be2-3d4a-4e8a-84b5-cd3bda91a4c0"}]} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:43:27.448163 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-037f7aae-8a24-48a0-a211-e0b6691732bb req-be11885e-7db7-48b0-b646-491085175911 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:27.448771 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-037f7aae-8a24-48a0-a211-e0b6691732bb req-be11885e-7db7-48b0-b646-491085175911 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:27.463531 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.compute.server_external_events [req-037f7aae-8a24-48a0-a211-e0b6691732bb req-be11885e-7db7-48b0-b646-491085175911 service nova] Creating event network-vif-plugged:b4171be2-3d4a-4e8a-84b5-cd3bda91a4c0 for instance 8ad215fb-dc14-4768-98d9-c57389e0d317 on hv-cinder-85032 Aug 01 16:43:27.471391 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [req-037f7aae-8a24-48a0-a211-e0b6691732bb req-be11885e-7db7-48b0-b646-491085175911 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048441 Aug 01 16:43:27.472403 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 284/575] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:43:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:43:28.441099 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-227ec755-3ad1-49ce-994f-677c493e790c tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:28.442198 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-227ec755-3ad1-49ce-994f-677c493e790c tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 8ad215fb-dc14-4768-98d9-c57389e0d317] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:28.449721 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-227ec755-3ad1-49ce-994f-677c493e790c tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:28.450346 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-227ec755-3ad1-49ce-994f-677c493e790c tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:28.451279 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-227ec755-3ad1-49ce-994f-677c493e790c tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:28.451895 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-227ec755-3ad1-49ce-994f-677c493e790c tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:28.468040 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-b51cd198-2a7a-44ab-98be-f654a765d6d3 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:28.470129 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-b51cd198-2a7a-44ab-98be-f654a765d6d3 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: 87f86dcf-be4f-4fb9-9957-d2c5c10d999c] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:28.485872 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-b51cd198-2a7a-44ab-98be-f654a765d6d3 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:28.488323 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-b51cd198-2a7a-44ab-98be-f654a765d6d3 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:28.488323 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-b51cd198-2a7a-44ab-98be-f654a765d6d3 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:28.489004 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-b51cd198-2a7a-44ab-98be-f654a765d6d3 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:28.583103 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_cell0:SELECT=2 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:43:28.811156 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_cell0:SELECT=2 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:43:28.842777 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-b51cd198-2a7a-44ab-98be-f654a765d6d3 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:28.853215 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-227ec755-3ad1-49ce-994f-677c493e790c tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac7d3acf1204a9f98f9ee14c2b46a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f46e472f8614c5e847ceb225cc9bff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:28.856062 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-b51cd198-2a7a-44ab-98be-f654a765d6d3 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c" status: 200 len: 1737 microversion: 2.1 time: 0.396565 Aug 01 16:43:28.864984 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-227ec755-3ad1-49ce-994f-677c493e790c tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/8ad215fb-dc14-4768-98d9-c57389e0d317" status: 200 len: 1367 microversion: 2.1 time: 0.428592 Aug 01 16:43:28.866608 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 292/576] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:43:28 2022] GET /compute/v2.1/servers/8ad215fb-dc14-4768-98d9-c57389e0d317 => generated 1367 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:43:28.873029 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 285/577] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:43:28 2022] GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c => generated 1737 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:43:28.874322 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-d572edfa-d695-41fe-bd94-9ee883def2a8 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:28.876314 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-d572edfa-d695-41fe-bd94-9ee883def2a8 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] [instance: 348b2621-1bf9-431b-b639-9aabbf68a3cf] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:28.878151 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [req-38fd461d-4233-49b4-9144-8c39304acf34 req-ce297088-3f5a-4a49-8964-cf9eed9fb625 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "348b2621-1bf9-431b-b639-9aabbf68a3cf", "tag": "8967f796-0a7a-4c6f-b2f7-18a05072b7c4"}]} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:43:28.885176 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-d572edfa-d695-41fe-bd94-9ee883def2a8 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:28.886003 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-d572edfa-d695-41fe-bd94-9ee883def2a8 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:28.887211 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-d572edfa-d695-41fe-bd94-9ee883def2a8 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:28.887829 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-d572edfa-d695-41fe-bd94-9ee883def2a8 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:28.888516 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-38fd461d-4233-49b4-9144-8c39304acf34 req-ce297088-3f5a-4a49-8964-cf9eed9fb625 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:28.888960 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-38fd461d-4233-49b4-9144-8c39304acf34 req-ce297088-3f5a-4a49-8964-cf9eed9fb625 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:28.902842 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.compute.server_external_events [req-38fd461d-4233-49b4-9144-8c39304acf34 req-ce297088-3f5a-4a49-8964-cf9eed9fb625 service nova] Creating event network-changed:8967f796-0a7a-4c6f-b2f7-18a05072b7c4 for instance 348b2621-1bf9-431b-b639-9aabbf68a3cf on hv-cinder-85032 Aug 01 16:43:28.909402 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [req-38fd461d-4233-49b4-9144-8c39304acf34 req-ce297088-3f5a-4a49-8964-cf9eed9fb625 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034958 Aug 01 16:43:28.910469 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 286/578] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:43:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:43:28.996014 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.objects.instance [None req-d572edfa-d695-41fe-bd94-9ee883def2a8 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lazy-loading 'services' on Instance uuid 348b2621-1bf9-431b-b639-9aabbf68a3cf {{(pid=118118) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 16:43:29.001573 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:43:29.090073 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-d572edfa-d695-41fe-bd94-9ee883def2a8 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] 10.222.0.45 "DELETE /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf/os-volume_attachments/ce3f0300-4d63-424d-a4e8-bdd57c52ba7b" status: 202 len: 0 microversion: 2.1 time: 0.221608 Aug 01 16:43:29.090766 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 293/579] 10.222.0.45 () {58 vars in 1416 bytes} [Mon Aug 1 16:43:28 2022] DELETE /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf/os-volume_attachments/ce3f0300-4d63-424d-a4e8-bdd57c52ba7b => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 16:43:29.109005 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-05f8a92c-67bc-4243-be8f-109eefc00a90 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:29.113501 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-05f8a92c-67bc-4243-be8f-109eefc00a90 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] [instance: 348b2621-1bf9-431b-b639-9aabbf68a3cf] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:29.123921 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-05f8a92c-67bc-4243-be8f-109eefc00a90 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:29.124599 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-05f8a92c-67bc-4243-be8f-109eefc00a90 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:29.125828 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-05f8a92c-67bc-4243-be8f-109eefc00a90 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:29.126339 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-05f8a92c-67bc-4243-be8f-109eefc00a90 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:29.168608 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-05f8a92c-67bc-4243-be8f-109eefc00a90 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] 10.222.0.45 "GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069852 Aug 01 16:43:29.169240 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 287/580] 10.222.0.45 () {58 vars in 1302 bytes} [Mon Aug 1 16:43:29 2022] GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:43:29.888843 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-1c7cbaf7-841a-4593-90da-b1d09dd85a59 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:29.890018 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-1c7cbaf7-841a-4593-90da-b1d09dd85a59 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: 87f86dcf-be4f-4fb9-9957-d2c5c10d999c] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:29.891556 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-a0fa2910-063a-46ed-a70c-c18b0909104b tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:29.892344 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-a0fa2910-063a-46ed-a70c-c18b0909104b tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 8ad215fb-dc14-4768-98d9-c57389e0d317] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:29.893997 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_cell0:SELECT=14 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:43:29.900848 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-1c7cbaf7-841a-4593-90da-b1d09dd85a59 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:29.901226 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-a0fa2910-063a-46ed-a70c-c18b0909104b tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:29.901687 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-a0fa2910-063a-46ed-a70c-c18b0909104b tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:29.901895 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-1c7cbaf7-841a-4593-90da-b1d09dd85a59 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:29.903079 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-1c7cbaf7-841a-4593-90da-b1d09dd85a59 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:29.903418 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-a0fa2910-063a-46ed-a70c-c18b0909104b tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:29.903733 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-1c7cbaf7-841a-4593-90da-b1d09dd85a59 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:29.904478 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-a0fa2910-063a-46ed-a70c-c18b0909104b tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:30.179994 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-a0fa2910-063a-46ed-a70c-c18b0909104b tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac7d3acf1204a9f98f9ee14c2b46a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f46e472f8614c5e847ceb225cc9bff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:30.186715 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-1c7cbaf7-841a-4593-90da-b1d09dd85a59 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:30.192519 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-a0fa2910-063a-46ed-a70c-c18b0909104b tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/8ad215fb-dc14-4768-98d9-c57389e0d317" status: 200 len: 1556 microversion: 2.1 time: 0.308761 Aug 01 16:43:30.194159 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 288/581] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:43:29 2022] GET /compute/v2.1/servers/8ad215fb-dc14-4768-98d9-c57389e0d317 => generated 1556 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:43:30.201468 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-1c7cbaf7-841a-4593-90da-b1d09dd85a59 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c" status: 200 len: 1737 microversion: 2.1 time: 0.317280 Aug 01 16:43:30.201682 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-8f1949b2-f361-407c-ab29-653dfdad224a tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:30.203398 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 294/582] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:43:29 2022] GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c => generated 1737 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:43:30.204752 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-8f1949b2-f361-407c-ab29-653dfdad224a tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] [instance: 348b2621-1bf9-431b-b639-9aabbf68a3cf] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:30.211813 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-8f1949b2-f361-407c-ab29-653dfdad224a tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:30.219662 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-8f1949b2-f361-407c-ab29-653dfdad224a tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:30.221848 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-8f1949b2-f361-407c-ab29-653dfdad224a tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:30.222415 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-35c9ef30-dcfc-416c-aebc-35a2ff1b7fc0 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:30.222626 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-8f1949b2-f361-407c-ab29-653dfdad224a tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:30.223298 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-35c9ef30-dcfc-416c-aebc-35a2ff1b7fc0 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 8ad215fb-dc14-4768-98d9-c57389e0d317] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:30.231540 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-35c9ef30-dcfc-416c-aebc-35a2ff1b7fc0 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:30.234066 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-35c9ef30-dcfc-416c-aebc-35a2ff1b7fc0 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:30.235831 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-35c9ef30-dcfc-416c-aebc-35a2ff1b7fc0 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:30.236825 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-35c9ef30-dcfc-416c-aebc-35a2ff1b7fc0 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:30.289897 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-8f1949b2-f361-407c-ab29-653dfdad224a tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] 10.222.0.45 "GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094345 Aug 01 16:43:30.292988 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 289/583] 10.222.0.45 () {58 vars in 1302 bytes} [Mon Aug 1 16:43:30 2022] GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:43:30.386872 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-35c9ef30-dcfc-416c-aebc-35a2ff1b7fc0 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/8ad215fb-dc14-4768-98d9-c57389e0d317/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.168854 Aug 01 16:43:30.390508 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 295/584] 10.222.0.45 () {58 vars in 1275 bytes} [Mon Aug 1 16:43:30 2022] GET /compute/v2.1/servers/8ad215fb-dc14-4768-98d9-c57389e0d317/os-interface => generated 285 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:43:31.236734 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-f1f73dfc-6f3b-4c8c-ac51-f77b2be11c2a tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:31.237435 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-f1f73dfc-6f3b-4c8c-ac51-f77b2be11c2a tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: 87f86dcf-be4f-4fb9-9957-d2c5c10d999c] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:31.244725 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-f1f73dfc-6f3b-4c8c-ac51-f77b2be11c2a tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:31.245412 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-f1f73dfc-6f3b-4c8c-ac51-f77b2be11c2a tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:31.246022 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-f1f73dfc-6f3b-4c8c-ac51-f77b2be11c2a tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:31.246679 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-f1f73dfc-6f3b-4c8c-ac51-f77b2be11c2a tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:31.315220 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-c9fd1b0d-c86d-412f-b0f9-e54bf9364d18 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:31.317644 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-c9fd1b0d-c86d-412f-b0f9-e54bf9364d18 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] [instance: 348b2621-1bf9-431b-b639-9aabbf68a3cf] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:31.327129 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-c9fd1b0d-c86d-412f-b0f9-e54bf9364d18 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:31.327813 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-c9fd1b0d-c86d-412f-b0f9-e54bf9364d18 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:31.328734 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-c9fd1b0d-c86d-412f-b0f9-e54bf9364d18 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:31.329174 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-c9fd1b0d-c86d-412f-b0f9-e54bf9364d18 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:31.371732 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-c9fd1b0d-c86d-412f-b0f9-e54bf9364d18 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] 10.222.0.45 "GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061299 Aug 01 16:43:31.372853 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 296/585] 10.222.0.45 () {58 vars in 1302 bytes} [Mon Aug 1 16:43:31 2022] GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 16:43:31.387100 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-dc6171b9-c6f5-4671-be7a-0d9ab9ebfabe tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:31.387979 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-dc6171b9-c6f5-4671-be7a-0d9ab9ebfabe tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] [instance: 348b2621-1bf9-431b-b639-9aabbf68a3cf] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:31.395735 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-dc6171b9-c6f5-4671-be7a-0d9ab9ebfabe tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:31.396239 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-dc6171b9-c6f5-4671-be7a-0d9ab9ebfabe tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:31.397017 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-dc6171b9-c6f5-4671-be7a-0d9ab9ebfabe tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:31.397444 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-dc6171b9-c6f5-4671-be7a-0d9ab9ebfabe tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:31.491133 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.wsgi [None req-dc6171b9-c6f5-4671-be7a-0d9ab9ebfabe tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] HTTP exception thrown: Instance 348b2621-1bf9-431b-b639-9aabbf68a3cf is not attached to volume ce3f0300-4d63-424d-a4e8-bdd57c52ba7b Aug 01 16:43:31.510361 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-dc6171b9-c6f5-4671-be7a-0d9ab9ebfabe tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Request method failure captured: Aug 01 16:43:31.510361 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: request: DELETE /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf/os-volume_attachments/ce3f0300-4d63-424d-a4e8-bdd57c52ba7b HTTP/1.1 Aug 01 16:43:31.510361 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Accept: application/json Aug 01 16:43:31.510361 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Accept-Encoding: identity Aug 01 16:43:31.510361 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Connection: close Aug 01 16:43:31.510361 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Content-Length: 0 Aug 01 16:43:31.510361 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Content-Type: application/json Aug 01 16:43:31.510361 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Host: 10.222.0.45 Aug 01 16:43:31.510361 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Openstack-System-Scope: None Aug 01 16:43:31.510361 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: User-Agent: python-urllib3/1.26.10 Aug 01 16:43:31.510361 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Auth-Token: gAAAAABi6AH2U3Xl6HEooyCdFFbMUw92Z4lcUXbLky7xjLr6pOGfEXeopxuITVqpTqO09zGHw0KG3SJNUSn6eU1lipx52xFCRoNrEo6BpnETPg-2pxIS5XBwCchHbKoMb2nS7_JN5Hiop_CWUMC4OMHPq46dfLc7Oxt9X_O5pQ2BRKhPphNMgG8 Aug 01 16:43:31.510361 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Domain-Id: None Aug 01 16:43:31.510361 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Domain-Name: None Aug 01 16:43:31.510361 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Identity-Status: Confirmed Aug 01 16:43:31.510361 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Is-Admin-Project: True Aug 01 16:43:31.510361 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Domain-Id: default Aug 01 16:43:31.510361 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Domain-Name: Default Aug 01 16:43:31.510361 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Id: 019734069da44b2d88561549bd07544d Aug 01 16:43:31.510361 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Name: tempest-TestMinimumBasicScenario-1069910106 Aug 01 16:43:31.510361 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Role: reader,member Aug 01 16:43:31.510361 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Roles: reader,member Aug 01 16:43:31.512480 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_019734069da44b2d88561549bd07544d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/019734069da44b2d88561549bd07544d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/019734069da44b2d88561549bd07544d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/019734069da44b2d88561549bd07544d"}]}] Aug 01 16:43:31.512480 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant: tempest-TestMinimumBasicScenario-1069910106 Aug 01 16:43:31.512480 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant-Id: 019734069da44b2d88561549bd07544d Aug 01 16:43:31.512480 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1069910106 Aug 01 16:43:31.512480 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User: tempest-TestMinimumBasicScenario-1069910106-project Aug 01 16:43:31.512480 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Domain-Id: default Aug 01 16:43:31.512480 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Domain-Name: Default Aug 01 16:43:31.512480 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Id: 23a95d9f48c64b0fbb8879d361bc177d Aug 01 16:43:31.512480 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Name: tempest-TestMinimumBasicScenario-1069910106-project Aug 01 16:43:31.512480 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: method: > Aug 01 16:43:31.512480 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: exception: Instance 348b2621-1bf9-431b-b639-9aabbf68a3cf is not attached to volume ce3f0300-4d63-424d-a4e8-bdd57c52ba7b Aug 01 16:43:31.513413 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: action_args: {'server_id': '348b2621-1bf9-431b-b639-9aabbf68a3cf', 'id': 'ce3f0300-4d63-424d-a4e8-bdd57c52ba7b'} Aug 01 16:43:31.513413 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:43:31.513413 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:43:31.513413 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 01 16:43:31.513413 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 01 16:43:31.513413 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 16:43:31.513413 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 16:43:31.513413 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 01 16:43:31.513413 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 01 16:43:31.513413 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id ce3f0300-4d63-424d-a4e8-bdd57c52ba7b. Aug 01 16:43:31.513413 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:43:31.513413 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:43:31.513413 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:43:31.513413 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:43:31.513413 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:43:31.513413 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:43:31.513413 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:43:31.513413 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:43:31.513413 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:43:31.516189 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:43:31.516189 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 01 16:43:31.516189 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 01 16:43:31.516189 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 348b2621-1bf9-431b-b639-9aabbf68a3cf is not attached to volume ce3f0300-4d63-424d-a4e8-bdd57c52ba7b Aug 01 16:43:31.516189 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:43:31.516189 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:43:31.516189 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:43:31.516189 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:43:31.516189 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:43:31.516189 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:43:31.516189 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:43:31.516189 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:43:31.516189 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 348b2621-1bf9-431b-b639-9aabbf68a3cf is not attached to volume ce3f0300-4d63-424d-a4e8-bdd57c52ba7b Aug 01 16:43:31.516189 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:43:31.516189 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-dc6171b9-c6f5-4671-be7a-0d9ab9ebfabe tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Returning 404 to user: Instance 348b2621-1bf9-431b-b639-9aabbf68a3cf is not attached to volume ce3f0300-4d63-424d-a4e8-bdd57c52ba7b {{(pid=118118) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:43:31.518187 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-dc6171b9-c6f5-4671-be7a-0d9ab9ebfabe tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] 10.222.0.45 "DELETE /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf/os-volume_attachments/ce3f0300-4d63-424d-a4e8-bdd57c52ba7b" status: 404 len: 154 microversion: 2.1 time: 0.130608 Aug 01 16:43:31.518187 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 297/586] 10.222.0.45 () {58 vars in 1416 bytes} [Mon Aug 1 16:43:31 2022] DELETE /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf/os-volume_attachments/ce3f0300-4d63-424d-a4e8-bdd57c52ba7b => generated 154 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 16:43:31.530698 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-f1f73dfc-6f3b-4c8c-ac51-f77b2be11c2a tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:31.542700 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-f1f73dfc-6f3b-4c8c-ac51-f77b2be11c2a tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c" status: 200 len: 1737 microversion: 2.1 time: 0.309654 Aug 01 16:43:31.543424 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 290/587] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:43:31 2022] GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c => generated 1737 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:43:31.913933 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [req-eba43677-0bb0-4b2f-8061-5051bcdf2779 req-87979f3e-ed50-4769-b10f-fdb4b88d5b9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ad215fb-dc14-4768-98d9-c57389e0d317", "tag": "b4171be2-3d4a-4e8a-84b5-cd3bda91a4c0"}]} {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:43:31.921862 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1,nova_api:INSERT=5 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:43:31.927308 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-eba43677-0bb0-4b2f-8061-5051bcdf2779 req-87979f3e-ed50-4769-b10f-fdb4b88d5b9d service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:31.931260 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-eba43677-0bb0-4b2f-8061-5051bcdf2779 req-87979f3e-ed50-4769-b10f-fdb4b88d5b9d service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:31.947307 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.compute.server_external_events [req-eba43677-0bb0-4b2f-8061-5051bcdf2779 req-87979f3e-ed50-4769-b10f-fdb4b88d5b9d service nova] Creating event network-changed:b4171be2-3d4a-4e8a-84b5-cd3bda91a4c0 for instance 8ad215fb-dc14-4768-98d9-c57389e0d317 on hv-cinder-85032 Aug 01 16:43:31.953219 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [req-eba43677-0bb0-4b2f-8061-5051bcdf2779 req-87979f3e-ed50-4769-b10f-fdb4b88d5b9d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050589 Aug 01 16:43:31.954159 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 298/588] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:43:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:43:32.580066 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-be920a7b-37ab-477a-a875-ee328ee3e7b2 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:32.580951 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-be920a7b-37ab-477a-a875-ee328ee3e7b2 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: 87f86dcf-be4f-4fb9-9957-d2c5c10d999c] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:32.589542 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-be920a7b-37ab-477a-a875-ee328ee3e7b2 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:32.590239 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-be920a7b-37ab-477a-a875-ee328ee3e7b2 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:32.591252 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-be920a7b-37ab-477a-a875-ee328ee3e7b2 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:32.592213 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-be920a7b-37ab-477a-a875-ee328ee3e7b2 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:32.731976 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-a525faf5-e3e5-496c-89d7-24f8f27979ed tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:32.736155 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-a525faf5-e3e5-496c-89d7-24f8f27979ed tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] [instance: 348b2621-1bf9-431b-b639-9aabbf68a3cf] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:32.756264 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a525faf5-e3e5-496c-89d7-24f8f27979ed tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:32.757249 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a525faf5-e3e5-496c-89d7-24f8f27979ed tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:32.758603 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a525faf5-e3e5-496c-89d7-24f8f27979ed tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:32.759239 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a525faf5-e3e5-496c-89d7-24f8f27979ed tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:32.790578 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-a525faf5-e3e5-496c-89d7-24f8f27979ed tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] [instance: 348b2621-1bf9-431b-b639-9aabbf68a3cf] Going to try to terminate instance {{(pid=118118) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 16:43:32.910321 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-a525faf5-e3e5-496c-89d7-24f8f27979ed tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] 10.222.0.45 "DELETE /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf" status: 204 len: 0 microversion: 2.1 time: 0.187657 Aug 01 16:43:32.914275 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 299/589] 10.222.0.45 () {58 vars in 1239 bytes} [Mon Aug 1 16:43:32 2022] DELETE /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 16:43:32.924972 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-562e7e8e-09c3-48fd-967b-5fac032c66c8 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:32.926326 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-562e7e8e-09c3-48fd-967b-5fac032c66c8 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] [instance: 348b2621-1bf9-431b-b639-9aabbf68a3cf] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:32.933877 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-562e7e8e-09c3-48fd-967b-5fac032c66c8 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:32.934452 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-562e7e8e-09c3-48fd-967b-5fac032c66c8 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:32.935378 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-562e7e8e-09c3-48fd-967b-5fac032c66c8 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:32.936344 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-562e7e8e-09c3-48fd-967b-5fac032c66c8 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:32.955524 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-be920a7b-37ab-477a-a875-ee328ee3e7b2 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:32.974967 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-be920a7b-37ab-477a-a875-ee328ee3e7b2 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c" status: 200 len: 1737 microversion: 2.1 time: 0.401527 Aug 01 16:43:32.977229 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 291/590] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:43:32 2022] GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c => generated 1737 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:43:33.123568 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-562e7e8e-09c3-48fd-967b-5fac032c66c8 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a95d9f48c64b0fbb8879d361bc177d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019734069da44b2d88561549bd07544d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:33.135122 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-562e7e8e-09c3-48fd-967b-5fac032c66c8 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] 10.222.0.45 "GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf" status: 200 len: 1554 microversion: 2.1 time: 0.215719 Aug 01 16:43:33.136340 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 300/591] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:43:32 2022] GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf => generated 1554 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:43:33.848468 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-59b2f546-ef79-48a4-8de3-ba7286704927 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:33.849087 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-59b2f546-ef79-48a4-8de3-ba7286704927 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:33.860171 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-59b2f546-ef79-48a4-8de3-ba7286704927 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:33.860927 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-59b2f546-ef79-48a4-8de3-ba7286704927 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:33.862144 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-59b2f546-ef79-48a4-8de3-ba7286704927 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:33.862862 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-59b2f546-ef79-48a4-8de3-ba7286704927 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:33.901327 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-59b2f546-ef79-48a4-8de3-ba7286704927 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e/os-volume_attachments/21dad921-8887-46e2-b691-d69dbdd6520e" status: 200 len: 194 microversion: 2.20 time: 0.058633 Aug 01 16:43:33.902045 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 292/592] 10.222.0.45 () {60 vars in 1454 bytes} [Mon Aug 1 16:43:33 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e/os-volume_attachments/21dad921-8887-46e2-b691-d69dbdd6520e => generated 194 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 16:43:33.985120 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-b24c6322-a7f3-496d-815c-95275c70bf60 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:33.986243 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-b24c6322-a7f3-496d-815c-95275c70bf60 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:33.993414 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-b24c6322-a7f3-496d-815c-95275c70bf60 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:33.993882 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-b24c6322-a7f3-496d-815c-95275c70bf60 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:33.994639 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-b24c6322-a7f3-496d-815c-95275c70bf60 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:33.995580 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-b24c6322-a7f3-496d-815c-95275c70bf60 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:34.000127 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-58a2ca22-7bb7-4e0b-9e0b-c7ba2e8ab62a tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:34.000777 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-58a2ca22-7bb7-4e0b-9e0b-c7ba2e8ab62a tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: 87f86dcf-be4f-4fb9-9957-d2c5c10d999c] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:34.007919 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-58a2ca22-7bb7-4e0b-9e0b-c7ba2e8ab62a tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:34.008302 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-58a2ca22-7bb7-4e0b-9e0b-c7ba2e8ab62a tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:34.009098 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-58a2ca22-7bb7-4e0b-9e0b-c7ba2e8ab62a tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:34.009547 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-58a2ca22-7bb7-4e0b-9e0b-c7ba2e8ab62a tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:34.107007 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.objects.instance [None req-b24c6322-a7f3-496d-815c-95275c70bf60 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lazy-loading 'services' on Instance uuid f1c8ed71-ea21-4bca-91bf-febe7457300e {{(pid=118118) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 16:43:34.190059 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-58a2ca22-7bb7-4e0b-9e0b-c7ba2e8ab62a tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:34.196494 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-b24c6322-a7f3-496d-815c-95275c70bf60 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "DELETE /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e/os-volume_attachments/21dad921-8887-46e2-b691-d69dbdd6520e" status: 202 len: 0 microversion: 2.20 time: 0.215657 Aug 01 16:43:34.200881 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 301/593] 10.222.0.45 () {60 vars in 1457 bytes} [Mon Aug 1 16:43:33 2022] DELETE /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e/os-volume_attachments/21dad921-8887-46e2-b691-d69dbdd6520e => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 01 16:43:34.201194 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-58a2ca22-7bb7-4e0b-9e0b-c7ba2e8ab62a tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c" status: 200 len: 1737 microversion: 2.1 time: 0.205027 Aug 01 16:43:34.206058 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 293/594] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:43:33 2022] GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c => generated 1737 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:43:34.207360 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-c514cc50-fba7-4c6a-b2ca-7ab4542aea0f tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:34.209996 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-c514cc50-fba7-4c6a-b2ca-7ab4542aea0f tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:34.210262 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-69bf4b58-f135-4e5b-b273-65c2164c85d4 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:34.210917 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-69bf4b58-f135-4e5b-b273-65c2164c85d4 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] [instance: 348b2621-1bf9-431b-b639-9aabbf68a3cf] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:34.219123 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-69bf4b58-f135-4e5b-b273-65c2164c85d4 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:34.219556 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-69bf4b58-f135-4e5b-b273-65c2164c85d4 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:34.220415 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-69bf4b58-f135-4e5b-b273-65c2164c85d4 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:34.220847 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-69bf4b58-f135-4e5b-b273-65c2164c85d4 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:34.222301 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-c514cc50-fba7-4c6a-b2ca-7ab4542aea0f tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:34.222753 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-c514cc50-fba7-4c6a-b2ca-7ab4542aea0f tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:34.223544 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-c514cc50-fba7-4c6a-b2ca-7ab4542aea0f tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:34.224046 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-c514cc50-fba7-4c6a-b2ca-7ab4542aea0f tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:34.227418 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:43:34.263463 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-c514cc50-fba7-4c6a-b2ca-7ab4542aea0f tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060403 Aug 01 16:43:34.264103 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 294/595] 10.222.0.45 () {60 vars in 1343 bytes} [Mon Aug 1 16:43:34 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 16:43:34.385226 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-69bf4b58-f135-4e5b-b273-65c2164c85d4 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a95d9f48c64b0fbb8879d361bc177d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019734069da44b2d88561549bd07544d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:34.393310 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-69bf4b58-f135-4e5b-b273-65c2164c85d4 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] 10.222.0.45 "GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf" status: 200 len: 1554 microversion: 2.1 time: 0.191117 Aug 01 16:43:34.393895 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 302/596] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:43:34 2022] GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf => generated 1554 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:43:35.231892 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-3ae3d409-0b15-40f8-ab72-718e6cedd4d0 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:35.232729 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-3ae3d409-0b15-40f8-ab72-718e6cedd4d0 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: 87f86dcf-be4f-4fb9-9957-d2c5c10d999c] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:35.244157 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-3ae3d409-0b15-40f8-ab72-718e6cedd4d0 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:35.244971 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-3ae3d409-0b15-40f8-ab72-718e6cedd4d0 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:35.246693 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-3ae3d409-0b15-40f8-ab72-718e6cedd4d0 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:35.247579 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-3ae3d409-0b15-40f8-ab72-718e6cedd4d0 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:35.277896 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-3de88614-d0c0-4a7a-8e63-cd04cc78d099 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:35.280449 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-3de88614-d0c0-4a7a-8e63-cd04cc78d099 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:35.288401 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3de88614-d0c0-4a7a-8e63-cd04cc78d099 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:35.288962 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3de88614-d0c0-4a7a-8e63-cd04cc78d099 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:35.290244 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3de88614-d0c0-4a7a-8e63-cd04cc78d099 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:35.295911 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3de88614-d0c0-4a7a-8e63-cd04cc78d099 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:35.330739 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-3de88614-d0c0-4a7a-8e63-cd04cc78d099 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057827 Aug 01 16:43:35.331779 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 303/597] 10.222.0.45 () {60 vars in 1343 bytes} [Mon Aug 1 16:43:35 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 16:43:35.421755 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-f45f11ec-b3e6-423b-81b0-1f66e6554501 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:35.422391 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-f45f11ec-b3e6-423b-81b0-1f66e6554501 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] [instance: 348b2621-1bf9-431b-b639-9aabbf68a3cf] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:35.429452 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-f45f11ec-b3e6-423b-81b0-1f66e6554501 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:35.430100 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-f45f11ec-b3e6-423b-81b0-1f66e6554501 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:35.430772 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-f45f11ec-b3e6-423b-81b0-1f66e6554501 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:35.431371 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-f45f11ec-b3e6-423b-81b0-1f66e6554501 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:35.495841 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-3ae3d409-0b15-40f8-ab72-718e6cedd4d0 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:35.508258 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-3ae3d409-0b15-40f8-ab72-718e6cedd4d0 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c" status: 200 len: 1737 microversion: 2.1 time: 0.282528 Aug 01 16:43:35.521238 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 295/598] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:43:35 2022] GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c => generated 1737 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:43:35.687326 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-f45f11ec-b3e6-423b-81b0-1f66e6554501 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a95d9f48c64b0fbb8879d361bc177d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '019734069da44b2d88561549bd07544d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:35.697294 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-f45f11ec-b3e6-423b-81b0-1f66e6554501 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] 10.222.0.45 "GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf" status: 200 len: 1554 microversion: 2.1 time: 0.281100 Aug 01 16:43:35.711899 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 304/599] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:43:35 2022] GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf => generated 1554 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:43:36.000003 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [req-1c4f16c5-d96f-41fc-b210-a06cf6059e30 req-e0ac8e44-2d79-4e7e-8e07-88cfd1f3455b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "348b2621-1bf9-431b-b639-9aabbf68a3cf", "name": "network-vif-deleted", "tag": "8967f796-0a7a-4c6f-b2f7-18a05072b7c4"}]} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:43:36.013480 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-1c4f16c5-d96f-41fc-b210-a06cf6059e30 req-e0ac8e44-2d79-4e7e-8e07-88cfd1f3455b service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:36.014026 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-1c4f16c5-d96f-41fc-b210-a06cf6059e30 req-e0ac8e44-2d79-4e7e-8e07-88cfd1f3455b service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:36.028101 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.compute.server_external_events [req-1c4f16c5-d96f-41fc-b210-a06cf6059e30 req-e0ac8e44-2d79-4e7e-8e07-88cfd1f3455b service nova] Creating event network-vif-deleted:8967f796-0a7a-4c6f-b2f7-18a05072b7c4 for instance 348b2621-1bf9-431b-b639-9aabbf68a3cf on hv-cinder-85032 Aug 01 16:43:36.034113 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [req-1c4f16c5-d96f-41fc-b210-a06cf6059e30 req-e0ac8e44-2d79-4e7e-8e07-88cfd1f3455b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039069 Aug 01 16:43:36.034751 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 296/600] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:43:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 16:43:36.348376 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-d9138076-824e-4d36-8b1d-c2f7bd3bafc4 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:36.348376 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-d9138076-824e-4d36-8b1d-c2f7bd3bafc4 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:36.355641 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-d9138076-824e-4d36-8b1d-c2f7bd3bafc4 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:36.357241 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-d9138076-824e-4d36-8b1d-c2f7bd3bafc4 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:36.357241 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-d9138076-824e-4d36-8b1d-c2f7bd3bafc4 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:36.357478 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-d9138076-824e-4d36-8b1d-c2f7bd3bafc4 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:36.390740 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-d9138076-824e-4d36-8b1d-c2f7bd3bafc4 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049585 Aug 01 16:43:36.392079 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 305/601] 10.222.0.45 () {60 vars in 1343 bytes} [Mon Aug 1 16:43:36 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:43:36.471541 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-1f55d306-fc28-424b-8dc5-3d802456e45a tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:36.472125 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-1f55d306-fc28-424b-8dc5-3d802456e45a tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:36.483284 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-1f55d306-fc28-424b-8dc5-3d802456e45a tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:36.483729 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-1f55d306-fc28-424b-8dc5-3d802456e45a tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:36.484563 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-1f55d306-fc28-424b-8dc5-3d802456e45a tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:36.484994 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-1f55d306-fc28-424b-8dc5-3d802456e45a tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:36.515585 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-1f55d306-fc28-424b-8dc5-3d802456e45a tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Going to try to terminate instance {{(pid=118117) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 16:43:36.532986 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-17f1be35-9c09-43cc-a1b1-64a641910695 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:36.533505 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-17f1be35-9c09-43cc-a1b1-64a641910695 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: 87f86dcf-be4f-4fb9-9957-d2c5c10d999c] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:36.540808 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-17f1be35-9c09-43cc-a1b1-64a641910695 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:36.541221 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-17f1be35-9c09-43cc-a1b1-64a641910695 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:36.542938 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-17f1be35-9c09-43cc-a1b1-64a641910695 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:36.543367 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-17f1be35-9c09-43cc-a1b1-64a641910695 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:36.624808 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-1f55d306-fc28-424b-8dc5-3d802456e45a tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "DELETE /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 204 len: 0 microversion: 2.20 time: 0.157986 Aug 01 16:43:36.625881 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 297/602] 10.222.0.45 () {60 vars in 1280 bytes} [Mon Aug 1 16:43:36 2022] DELETE /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 01 16:43:36.635107 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-1a909ee2-96ff-4f35-8059-40c6cf95e715 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:36.636030 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-1a909ee2-96ff-4f35-8059-40c6cf95e715 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:36.644867 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-1a909ee2-96ff-4f35-8059-40c6cf95e715 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:36.645311 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-1a909ee2-96ff-4f35-8059-40c6cf95e715 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:36.646077 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-1a909ee2-96ff-4f35-8059-40c6cf95e715 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:36.646532 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-1a909ee2-96ff-4f35-8059-40c6cf95e715 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:36.755669 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-17f1be35-9c09-43cc-a1b1-64a641910695 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:36.765176 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-17f1be35-9c09-43cc-a1b1-64a641910695 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c" status: 200 len: 1737 microversion: 2.1 time: 0.236901 Aug 01 16:43:36.766064 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 306/603] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:43:36 2022] GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c => generated 1737 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:43:36.770960 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-c53c359a-ea46-4e88-a030-5d002c5937d2 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:36.771562 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-c53c359a-ea46-4e88-a030-5d002c5937d2 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] [instance: 348b2621-1bf9-431b-b639-9aabbf68a3cf] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:36.778415 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-c53c359a-ea46-4e88-a030-5d002c5937d2 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:36.778850 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-c53c359a-ea46-4e88-a030-5d002c5937d2 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:36.779644 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-c53c359a-ea46-4e88-a030-5d002c5937d2 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:36.780108 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-c53c359a-ea46-4e88-a030-5d002c5937d2 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:36.794543 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.wsgi [None req-c53c359a-ea46-4e88-a030-5d002c5937d2 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] HTTP exception thrown: Instance 348b2621-1bf9-431b-b639-9aabbf68a3cf could not be found. Aug 01 16:43:36.797069 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-c53c359a-ea46-4e88-a030-5d002c5937d2 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Request method failure captured: Aug 01 16:43:36.797069 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: request: GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf HTTP/1.1 Aug 01 16:43:36.797069 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Accept: application/json Aug 01 16:43:36.797069 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Accept-Encoding: identity Aug 01 16:43:36.797069 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Connection: close Aug 01 16:43:36.797069 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Content-Length: 0 Aug 01 16:43:36.797069 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Content-Type: application/json Aug 01 16:43:36.797069 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Host: 10.222.0.45 Aug 01 16:43:36.797069 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Openstack-System-Scope: None Aug 01 16:43:36.797069 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: User-Agent: python-urllib3/1.26.10 Aug 01 16:43:36.797069 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Auth-Token: gAAAAABi6AH2U3Xl6HEooyCdFFbMUw92Z4lcUXbLky7xjLr6pOGfEXeopxuITVqpTqO09zGHw0KG3SJNUSn6eU1lipx52xFCRoNrEo6BpnETPg-2pxIS5XBwCchHbKoMb2nS7_JN5Hiop_CWUMC4OMHPq46dfLc7Oxt9X_O5pQ2BRKhPphNMgG8 Aug 01 16:43:36.797069 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Domain-Id: None Aug 01 16:43:36.797069 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Domain-Name: None Aug 01 16:43:36.797069 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Identity-Status: Confirmed Aug 01 16:43:36.797069 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Is-Admin-Project: True Aug 01 16:43:36.797069 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Domain-Id: default Aug 01 16:43:36.797069 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Domain-Name: Default Aug 01 16:43:36.797069 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Id: 019734069da44b2d88561549bd07544d Aug 01 16:43:36.797069 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Name: tempest-TestMinimumBasicScenario-1069910106 Aug 01 16:43:36.797069 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Role: reader,member Aug 01 16:43:36.797069 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Roles: reader,member Aug 01 16:43:36.798603 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_019734069da44b2d88561549bd07544d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/019734069da44b2d88561549bd07544d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/019734069da44b2d88561549bd07544d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/019734069da44b2d88561549bd07544d"}]}] Aug 01 16:43:36.798603 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant: tempest-TestMinimumBasicScenario-1069910106 Aug 01 16:43:36.798603 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant-Id: 019734069da44b2d88561549bd07544d Aug 01 16:43:36.798603 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1069910106 Aug 01 16:43:36.798603 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User: tempest-TestMinimumBasicScenario-1069910106-project Aug 01 16:43:36.798603 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Domain-Id: default Aug 01 16:43:36.798603 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Domain-Name: Default Aug 01 16:43:36.798603 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Id: 23a95d9f48c64b0fbb8879d361bc177d Aug 01 16:43:36.798603 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Name: tempest-TestMinimumBasicScenario-1069910106-project Aug 01 16:43:36.798603 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: method: > Aug 01 16:43:36.798603 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: exception: Instance 348b2621-1bf9-431b-b639-9aabbf68a3cf could not be found. Aug 01 16:43:36.798603 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: action_args: {'id': '348b2621-1bf9-431b-b639-9aabbf68a3cf'} Aug 01 16:43:36.799447 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:43:36.799447 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:43:36.799447 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 16:43:36.799447 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 16:43:36.799447 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 16:43:36.799447 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 16:43:36.799447 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 16:43:36.799447 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 16:43:36.799447 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 16:43:36.799447 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 16:43:36.799447 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 348b2621-1bf9-431b-b639-9aabbf68a3cf could not be found. Aug 01 16:43:36.799447 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:43:36.799447 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:43:36.799447 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:43:36.799447 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:43:36.799447 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:43:36.799447 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:43:36.799447 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:43:36.799447 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:43:36.799447 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:43:36.801018 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:43:36.801018 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 16:43:36.801018 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 16:43:36.801018 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 16:43:36.801018 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 16:43:36.801018 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 16:43:36.801018 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:43:36.801018 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 348b2621-1bf9-431b-b639-9aabbf68a3cf could not be found. Aug 01 16:43:36.801018 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:43:36.801018 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:43:36.801018 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:43:36.801018 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:43:36.801018 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:43:36.801018 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:43:36.801018 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:43:36.801018 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:43:36.801018 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 348b2621-1bf9-431b-b639-9aabbf68a3cf could not be found. Aug 01 16:43:36.801018 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:43:36.802344 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-c53c359a-ea46-4e88-a030-5d002c5937d2 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Returning 404 to user: Instance 348b2621-1bf9-431b-b639-9aabbf68a3cf could not be found. {{(pid=118118) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:43:36.802344 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-c53c359a-ea46-4e88-a030-5d002c5937d2 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] 10.222.0.45 "GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf" status: 404 len: 111 microversion: 2.1 time: 0.032163 Aug 01 16:43:36.802344 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 307/604] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:43:36 2022] GET /compute/v2.1/servers/348b2621-1bf9-431b-b639-9aabbf68a3cf => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 16:43:36.807262 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-1a909ee2-96ff-4f35-8059-40c6cf95e715 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:36.808527 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-76f97802-8715-423d-b100-f55c25943263 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] Calling method '.version_select at 0x7efd5ed17f70>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:36.816593 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-1a909ee2-96ff-4f35-8059-40c6cf95e715 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:36.818173 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-1a909ee2-96ff-4f35-8059-40c6cf95e715 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:36.819406 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-1a909ee2-96ff-4f35-8059-40c6cf95e715 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1724 microversion: 2.20 time: 0.188655 Aug 01 16:43:36.820069 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 298/605] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:43:36 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1724 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 16:43:36.831511 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-76f97802-8715-423d-b100-f55c25943263 tempest-TestMinimumBasicScenario-1069910106 tempest-TestMinimumBasicScenario-1069910106-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-777072474" status: 202 len: 0 microversion: 2.1 time: 0.026771 Aug 01 16:43:36.832166 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 308/606] 10.222.0.45 () {58 vars in 1269 bytes} [Mon Aug 1 16:43:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-777072474 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 01 16:43:37.786988 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-36ea8990-69ad-40a7-ba88-b680d6dfe094 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:37.787574 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-36ea8990-69ad-40a7-ba88-b680d6dfe094 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: 87f86dcf-be4f-4fb9-9957-d2c5c10d999c] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:37.794967 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-36ea8990-69ad-40a7-ba88-b680d6dfe094 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:37.795416 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-36ea8990-69ad-40a7-ba88-b680d6dfe094 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:37.796228 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-36ea8990-69ad-40a7-ba88-b680d6dfe094 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:37.796655 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-36ea8990-69ad-40a7-ba88-b680d6dfe094 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:37.843022 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-5a5e7b65-9042-43ed-8f38-f146508b3103 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:37.844321 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-5a5e7b65-9042-43ed-8f38-f146508b3103 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:37.850704 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-5a5e7b65-9042-43ed-8f38-f146508b3103 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:37.851153 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-5a5e7b65-9042-43ed-8f38-f146508b3103 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:37.851958 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-5a5e7b65-9042-43ed-8f38-f146508b3103 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:37.852574 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-5a5e7b65-9042-43ed-8f38-f146508b3103 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:38.116400 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-36ea8990-69ad-40a7-ba88-b680d6dfe094 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:38.137909 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-36ea8990-69ad-40a7-ba88-b680d6dfe094 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c" status: 200 len: 1737 microversion: 2.1 time: 0.354683 Aug 01 16:43:38.138775 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 299/607] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:43:37 2022] GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c => generated 1737 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:43:38.152241 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-5a5e7b65-9042-43ed-8f38-f146508b3103 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:38.160615 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-5a5e7b65-9042-43ed-8f38-f146508b3103 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:38.162108 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-5a5e7b65-9042-43ed-8f38-f146508b3103 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:38.163263 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-5a5e7b65-9042-43ed-8f38-f146508b3103 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1724 microversion: 2.20 time: 0.324328 Aug 01 16:43:38.164121 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 309/608] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:43:37 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1724 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:43:38.192725 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-9c8abb7c-32fe-4dcb-ba22-8576d01bb782 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1512681619", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1173141553", "security_groups": [{"name": "tempest-secgroup-smoke-1642957585"}], "block_device_mapping_v2": [{"uuid": "ea4adc0e-ba04-4687-8426-016d95e5ab3b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f2f38df7-15f3-4c49-abb4-95c1ce8da0a5"}]}} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:43:38.383570 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.network.neutron [None req-9c8abb7c-32fe-4dcb-ba22-8576d01bb782 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] validate_networks() for [('f2f38df7-15f3-4c49-abb4-95c1ce8da0a5', None, None, None, None, None)] {{(pid=118117) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 16:43:39.161988 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-7217348b-57ad-4382-9c58-c740520330f4 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:39.163441 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-7217348b-57ad-4382-9c58-c740520330f4 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: 87f86dcf-be4f-4fb9-9957-d2c5c10d999c] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:39.171755 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-7217348b-57ad-4382-9c58-c740520330f4 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:39.172281 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-7217348b-57ad-4382-9c58-c740520330f4 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:39.173328 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-7217348b-57ad-4382-9c58-c740520330f4 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:39.173751 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-7217348b-57ad-4382-9c58-c740520330f4 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:39.190731 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:43:39.498580 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.virt.hardware [None req-9c8abb7c-32fe-4dcb-ba22-8576d01bb782 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Flavor limits 0:0:0 {{(pid=118117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 16:43:39.499107 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.virt.hardware [None req-9c8abb7c-32fe-4dcb-ba22-8576d01bb782 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Image limits 0:0:0 {{(pid=118117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 16:43:39.499453 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.virt.hardware [None req-9c8abb7c-32fe-4dcb-ba22-8576d01bb782 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Flavor pref 0:0:0 {{(pid=118117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 16:43:39.499892 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.virt.hardware [None req-9c8abb7c-32fe-4dcb-ba22-8576d01bb782 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Image pref 0:0:0 {{(pid=118117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 16:43:39.500298 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.virt.hardware [None req-9c8abb7c-32fe-4dcb-ba22-8576d01bb782 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 16:43:39.510344 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-9c8abb7c-32fe-4dcb-ba22-8576d01bb782 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:39.510849 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-9c8abb7c-32fe-4dcb-ba22-8576d01bb782 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:39.511641 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-9c8abb7c-32fe-4dcb-ba22-8576d01bb782 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:39.512500 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-9c8abb7c-32fe-4dcb-ba22-8576d01bb782 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:39.539248 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.quota [None req-9c8abb7c-32fe-4dcb-ba22-8576d01bb782 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Getting quotas for project c86fcc5e23854dfba97058deac8211d0. Resources: {'cores', 'ram', 'instances'} {{(pid=118117) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 16:43:39.544209 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.quota [None req-9c8abb7c-32fe-4dcb-ba22-8576d01bb782 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Getting quotas for user 22cfd17a6f434deca7ef77253ae3ed2f and project c86fcc5e23854dfba97058deac8211d0. Resources: {'cores', 'ram', 'instances'} {{(pid=118117) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 16:43:39.609592 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-9c8abb7c-32fe-4dcb-ba22-8576d01bb782 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Going to run 1 instances... {{(pid=118117) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 16:43:39.611885 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-9c8abb7c-32fe-4dcb-ba22-8576d01bb782 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] [instance: 45745fab-4299-4cef-a04a-619855e55336] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ea4adc0e-ba04-4687-8426-016d95e5ab3b',volume_size=None,volume_type=None)] {{(pid=118117) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 16:43:39.762491 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-9c8abb7c-32fe-4dcb-ba22-8576d01bb782 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.573536 Aug 01 16:43:39.763271 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 300/609] 10.222.0.45 () {60 vars in 1147 bytes} [Mon Aug 1 16:43:38 2022] POST /compute/v2.1/servers => generated 406 bytes in 1575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 16:43:39.771712 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-62a9acf0-c50f-4994-86f2-02c7da6941e5 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:39.772109 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-62a9acf0-c50f-4994-86f2-02c7da6941e5 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:39.779499 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-62a9acf0-c50f-4994-86f2-02c7da6941e5 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:39.780080 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-62a9acf0-c50f-4994-86f2-02c7da6941e5 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:39.781336 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-62a9acf0-c50f-4994-86f2-02c7da6941e5 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:39.781484 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-62a9acf0-c50f-4994-86f2-02c7da6941e5 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:39.905676 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-7217348b-57ad-4382-9c58-c740520330f4 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:39.914182 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-7217348b-57ad-4382-9c58-c740520330f4 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c" status: 200 len: 1737 microversion: 2.1 time: 0.756241 Aug 01 16:43:39.915357 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 310/610] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:43:39 2022] GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c => generated 1737 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:43:39.929008 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-2ef489d9-435b-43c6-92ba-c753dbabd754 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:39.929830 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-2ef489d9-435b-43c6-92ba-c753dbabd754 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] [instance: 45745fab-4299-4cef-a04a-619855e55336] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:40.036532 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-2ef489d9-435b-43c6-92ba-c753dbabd754 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22cfd17a6f434deca7ef77253ae3ed2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86fcc5e23854dfba97058deac8211d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:40.050989 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-2ef489d9-435b-43c6-92ba-c753dbabd754 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] 10.222.0.45 "GET /compute/v2.1/servers/45745fab-4299-4cef-a04a-619855e55336" status: 200 len: 1095 microversion: 2.1 time: 0.133619 Aug 01 16:43:40.052873 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 311/611] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:43:39 2022] GET /compute/v2.1/servers/45745fab-4299-4cef-a04a-619855e55336 => generated 1095 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:43:40.191596 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-62a9acf0-c50f-4994-86f2-02c7da6941e5 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:40.201948 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-62a9acf0-c50f-4994-86f2-02c7da6941e5 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:40.203863 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-62a9acf0-c50f-4994-86f2-02c7da6941e5 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:40.205682 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-62a9acf0-c50f-4994-86f2-02c7da6941e5 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1724 microversion: 2.20 time: 0.441306 Aug 01 16:43:40.206581 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 301/612] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:43:39 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1724 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:43:40.705475 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [req-9fc964d4-ee91-4191-89ad-62f0b2c052c6 req-52a3b412-54ab-46a0-8fb7-de0b9f563bfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1c8ed71-ea21-4bca-91bf-febe7457300e", "name": "network-vif-deleted", "tag": "734cefe8-e715-4af3-bebc-f135e61eb70c"}]} {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:43:40.744877 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-9fc964d4-ee91-4191-89ad-62f0b2c052c6 req-52a3b412-54ab-46a0-8fb7-de0b9f563bfb service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:40.745625 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-9fc964d4-ee91-4191-89ad-62f0b2c052c6 req-52a3b412-54ab-46a0-8fb7-de0b9f563bfb service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:40.781109 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.compute.server_external_events [req-9fc964d4-ee91-4191-89ad-62f0b2c052c6 req-52a3b412-54ab-46a0-8fb7-de0b9f563bfb service nova] Creating event network-vif-deleted:734cefe8-e715-4af3-bebc-f135e61eb70c for instance f1c8ed71-ea21-4bca-91bf-febe7457300e on hv-cinder-85032 Aug 01 16:43:40.789054 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [req-9fc964d4-ee91-4191-89ad-62f0b2c052c6 req-52a3b412-54ab-46a0-8fb7-de0b9f563bfb service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087056 Aug 01 16:43:40.790422 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 312/613] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:43:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:43:40.924912 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-e344e2bf-f620-4f5d-b172-e05becd6c65d tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:40.929385 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-e344e2bf-f620-4f5d-b172-e05becd6c65d tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: a3f6b512-e3cb-4e87-8d82-c64f6f1640db] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:40.940786 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-1c2b857e-569e-47a4-9499-24e497ee90d7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:40.941942 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-1c2b857e-569e-47a4-9499-24e497ee90d7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: 87f86dcf-be4f-4fb9-9957-d2c5c10d999c] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:40.955559 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-e344e2bf-f620-4f5d-b172-e05becd6c65d tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:40.956428 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-e344e2bf-f620-4f5d-b172-e05becd6c65d tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:40.957794 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-e344e2bf-f620-4f5d-b172-e05becd6c65d tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:40.959395 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-1c2b857e-569e-47a4-9499-24e497ee90d7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:40.960690 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-1c2b857e-569e-47a4-9499-24e497ee90d7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:40.961164 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-e344e2bf-f620-4f5d-b172-e05becd6c65d tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:40.962948 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-1c2b857e-569e-47a4-9499-24e497ee90d7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:40.965360 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-1c2b857e-569e-47a4-9499-24e497ee90d7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:41.032764 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-e344e2bf-f620-4f5d-b172-e05becd6c65d tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.114559 Aug 01 16:43:41.034633 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 302/614] 10.222.0.45 () {58 vars in 1302 bytes} [Mon Aug 1 16:43:40 2022] GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db/os-volume_attachments => generated 25 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 16:43:41.080338 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-112eac12-ff0a-4280-b4c9-5107bc17a5c1 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:41.082185 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-112eac12-ff0a-4280-b4c9-5107bc17a5c1 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] [instance: 45745fab-4299-4cef-a04a-619855e55336] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:41.112315 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-112eac12-ff0a-4280-b4c9-5107bc17a5c1 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:41.115145 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-112eac12-ff0a-4280-b4c9-5107bc17a5c1 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:41.117136 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-112eac12-ff0a-4280-b4c9-5107bc17a5c1 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:41.119036 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-112eac12-ff0a-4280-b4c9-5107bc17a5c1 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:41.311110 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-112eac12-ff0a-4280-b4c9-5107bc17a5c1 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22cfd17a6f434deca7ef77253ae3ed2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86fcc5e23854dfba97058deac8211d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:41.319885 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-112eac12-ff0a-4280-b4c9-5107bc17a5c1 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] 10.222.0.45 "GET /compute/v2.1/servers/45745fab-4299-4cef-a04a-619855e55336" status: 200 len: 1211 microversion: 2.1 time: 0.249107 Aug 01 16:43:41.332155 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 303/615] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:43:41 2022] GET /compute/v2.1/servers/45745fab-4299-4cef-a04a-619855e55336 => generated 1211 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:43:41.334680 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-da48a7cf-c1ed-40ed-972e-27f9673f62fc tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:41.335245 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-da48a7cf-c1ed-40ed-972e-27f9673f62fc tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: a3f6b512-e3cb-4e87-8d82-c64f6f1640db] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:41.351944 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-da48a7cf-c1ed-40ed-972e-27f9673f62fc tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:41.352396 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-da48a7cf-c1ed-40ed-972e-27f9673f62fc tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:41.353174 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-da48a7cf-c1ed-40ed-972e-27f9673f62fc tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:41.353607 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-da48a7cf-c1ed-40ed-972e-27f9673f62fc tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:41.373960 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-1c2b857e-569e-47a4-9499-24e497ee90d7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:41.387610 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-1c2b857e-569e-47a4-9499-24e497ee90d7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c" status: 200 len: 1737 microversion: 2.1 time: 0.453364 Aug 01 16:43:41.391185 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 313/616] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:43:40 2022] GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c => generated 1737 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:43:41.403576 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-52630b26-9fec-4f64-8fb6-a679543c2a4b tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:41.404221 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-52630b26-9fec-4f64-8fb6-a679543c2a4b tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:41.412033 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-da48a7cf-c1ed-40ed-972e-27f9673f62fc tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: a3f6b512-e3cb-4e87-8d82-c64f6f1640db] Going to try to terminate instance {{(pid=118117) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 16:43:41.418669 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-52630b26-9fec-4f64-8fb6-a679543c2a4b tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:41.421266 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-52630b26-9fec-4f64-8fb6-a679543c2a4b tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:41.424425 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-52630b26-9fec-4f64-8fb6-a679543c2a4b tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:41.425070 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-52630b26-9fec-4f64-8fb6-a679543c2a4b tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:41.485075 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-52630b26-9fec-4f64-8fb6-a679543c2a4b tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:41.485899 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-52630b26-9fec-4f64-8fb6-a679543c2a4b tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:41.486756 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.objects.instance [None req-52630b26-9fec-4f64-8fb6-a679543c2a4b tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lazy-loading 'fault' on Instance uuid f1c8ed71-ea21-4bca-91bf-febe7457300e {{(pid=118118) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 16:43:41.582220 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-da48a7cf-c1ed-40ed-972e-27f9673f62fc tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "DELETE /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db" status: 204 len: 0 microversion: 2.1 time: 0.256559 Aug 01 16:43:41.583503 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 304/617] 10.222.0.45 () {58 vars in 1239 bytes} [Mon Aug 1 16:43:41 2022] DELETE /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 16:43:41.595967 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-53a7b99c-f8d5-4a9a-92ac-ffc503dbcecf tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:41.597693 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-53a7b99c-f8d5-4a9a-92ac-ffc503dbcecf tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: a3f6b512-e3cb-4e87-8d82-c64f6f1640db] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:41.608128 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-53a7b99c-f8d5-4a9a-92ac-ffc503dbcecf tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:41.608900 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-53a7b99c-f8d5-4a9a-92ac-ffc503dbcecf tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:41.609790 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-53a7b99c-f8d5-4a9a-92ac-ffc503dbcecf tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:41.610334 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-53a7b99c-f8d5-4a9a-92ac-ffc503dbcecf tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:41.615532 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-52630b26-9fec-4f64-8fb6-a679543c2a4b tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:41.625777 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-52630b26-9fec-4f64-8fb6-a679543c2a4b tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:41.630062 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-52630b26-9fec-4f64-8fb6-a679543c2a4b tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:41.631442 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-52630b26-9fec-4f64-8fb6-a679543c2a4b tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 200 len: 1371 microversion: 2.20 time: 0.238212 Aug 01 16:43:41.633490 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 314/618] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:43:41 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 1371 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:43:41.851342 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-53a7b99c-f8d5-4a9a-92ac-ffc503dbcecf tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0aed0278344119aae6906f4f52b1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b66d46c3e7d42b88f2dbdc01232fb03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:41.866325 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-53a7b99c-f8d5-4a9a-92ac-ffc503dbcecf tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db" status: 200 len: 1671 microversion: 2.1 time: 0.277599 Aug 01 16:43:41.880265 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 305/619] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:43:41 2022] GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db => generated 1671 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:43:42.342343 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-1c7754fa-8e5f-4d1f-adcf-2bf6bd593710 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:42.342948 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-1c7754fa-8e5f-4d1f-adcf-2bf6bd593710 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] [instance: 45745fab-4299-4cef-a04a-619855e55336] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:42.349926 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-1c7754fa-8e5f-4d1f-adcf-2bf6bd593710 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:42.350359 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-1c7754fa-8e5f-4d1f-adcf-2bf6bd593710 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:42.351135 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-1c7754fa-8e5f-4d1f-adcf-2bf6bd593710 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:42.351557 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-1c7754fa-8e5f-4d1f-adcf-2bf6bd593710 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:42.413658 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-f86bae84-77ff-4c96-b1a0-11f1b657a0ce tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:42.414268 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-f86bae84-77ff-4c96-b1a0-11f1b657a0ce tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: 87f86dcf-be4f-4fb9-9957-d2c5c10d999c] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:42.417549 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:43:42.423355 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-f86bae84-77ff-4c96-b1a0-11f1b657a0ce tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:42.423736 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-f86bae84-77ff-4c96-b1a0-11f1b657a0ce tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:42.424547 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-f86bae84-77ff-4c96-b1a0-11f1b657a0ce tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:42.424978 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-f86bae84-77ff-4c96-b1a0-11f1b657a0ce tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:42.438877 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-1c7754fa-8e5f-4d1f-adcf-2bf6bd593710 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22cfd17a6f434deca7ef77253ae3ed2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86fcc5e23854dfba97058deac8211d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:42.448662 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-1c7754fa-8e5f-4d1f-adcf-2bf6bd593710 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] 10.222.0.45 "GET /compute/v2.1/servers/45745fab-4299-4cef-a04a-619855e55336" status: 200 len: 1211 microversion: 2.1 time: 0.110501 Aug 01 16:43:42.449536 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 315/620] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:43:42 2022] GET /compute/v2.1/servers/45745fab-4299-4cef-a04a-619855e55336 => generated 1211 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:43:42.659930 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-063ed49c-e598-4f95-bd5f-10ceb05bb727 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:42.660537 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-063ed49c-e598-4f95-bd5f-10ceb05bb727 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:42.670146 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-f86bae84-77ff-4c96-b1a0-11f1b657a0ce tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:42.705776 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-063ed49c-e598-4f95-bd5f-10ceb05bb727 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:42.706227 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-063ed49c-e598-4f95-bd5f-10ceb05bb727 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:42.707018 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-063ed49c-e598-4f95-bd5f-10ceb05bb727 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:42.707451 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-063ed49c-e598-4f95-bd5f-10ceb05bb727 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:42.710477 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-f86bae84-77ff-4c96-b1a0-11f1b657a0ce tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c" status: 200 len: 1737 microversion: 2.1 time: 0.285896 Aug 01 16:43:42.711295 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 306/621] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:43:42 2022] GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c => generated 1737 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:43:42.733891 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.wsgi [None req-063ed49c-e598-4f95-bd5f-10ceb05bb727 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] HTTP exception thrown: Instance f1c8ed71-ea21-4bca-91bf-febe7457300e could not be found. Aug 01 16:43:42.735601 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-063ed49c-e598-4f95-bd5f-10ceb05bb727 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Request method failure captured: Aug 01 16:43:42.735601 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: request: GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e HTTP/1.1 Aug 01 16:43:42.735601 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Accept: application/json Aug 01 16:43:42.735601 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Accept-Encoding: identity Aug 01 16:43:42.735601 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Connection: close Aug 01 16:43:42.735601 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Content-Length: 0 Aug 01 16:43:42.735601 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Content-Type: application/json Aug 01 16:43:42.735601 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Host: 10.222.0.45 Aug 01 16:43:42.735601 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Openstack-System-Scope: None Aug 01 16:43:42.735601 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: User-Agent: python-urllib3/1.26.10 Aug 01 16:43:42.735601 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Auth-Token: gAAAAABi6AG_hl-bZ6rN8VgIzIgYQmKIJrpE_YJvPjFkFU5GY1KXh43jSdEOX4F-wcLiIiFE4D_YNym_uPyXkHUxQDtrtjN7Z5NzQuDnL6OkOovHTdJG0RqHpdBj_sOja0dq8ropReHPCzLVeRUou4ZAb8kaS3P9rHsZseZqnk5FsUUpCU5iqzQ Aug 01 16:43:42.735601 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Domain-Id: None Aug 01 16:43:42.735601 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Domain-Name: None Aug 01 16:43:42.735601 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Identity-Status: Confirmed Aug 01 16:43:42.735601 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Is-Admin-Project: True Aug 01 16:43:42.735601 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Openstack-Nova-Api-Version: 2.20 Aug 01 16:43:42.735601 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Domain-Id: default Aug 01 16:43:42.735601 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Domain-Name: Default Aug 01 16:43:42.735601 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Id: 4c1c9729df694f46987e6dd30a09d5d2 Aug 01 16:43:42.735601 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1626101148 Aug 01 16:43:42.735601 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Role: reader,member Aug 01 16:43:42.735601 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Roles: reader,member Aug 01 16:43:42.737065 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_4c1c9729df694f46987e6dd30a09d5d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/4c1c9729df694f46987e6dd30a09d5d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4c1c9729df694f46987e6dd30a09d5d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4c1c9729df694f46987e6dd30a09d5d2"}]}] Aug 01 16:43:42.737065 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1626101148 Aug 01 16:43:42.737065 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant-Id: 4c1c9729df694f46987e6dd30a09d5d2 Aug 01 16:43:42.737065 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1626101148 Aug 01 16:43:42.737065 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User: tempest-AttachVolumeShelveTestJSON-1626101148-project Aug 01 16:43:42.737065 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Domain-Id: default Aug 01 16:43:42.737065 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Domain-Name: Default Aug 01 16:43:42.737065 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Id: 76c1fab92b854cd8937cc80818159191 Aug 01 16:43:42.737065 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1626101148-project Aug 01 16:43:42.737065 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: method: > Aug 01 16:43:42.737065 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: exception: Instance f1c8ed71-ea21-4bca-91bf-febe7457300e could not be found. Aug 01 16:43:42.737065 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: action_args: {'id': 'f1c8ed71-ea21-4bca-91bf-febe7457300e'} Aug 01 16:43:42.737797 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:43:42.737797 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:43:42.737797 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 16:43:42.737797 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 16:43:42.737797 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 16:43:42.737797 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 16:43:42.737797 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 16:43:42.737797 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 16:43:42.737797 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 16:43:42.737797 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 16:43:42.737797 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1c8ed71-ea21-4bca-91bf-febe7457300e could not be found. Aug 01 16:43:42.737797 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:43:42.737797 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:43:42.737797 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:43:42.737797 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:43:42.737797 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:43:42.737797 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:43:42.737797 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:43:42.737797 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:43:42.737797 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:43:42.738945 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:43:42.738945 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 16:43:42.738945 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 16:43:42.738945 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 16:43:42.738945 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 16:43:42.738945 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 16:43:42.738945 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:43:42.738945 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1c8ed71-ea21-4bca-91bf-febe7457300e could not be found. Aug 01 16:43:42.738945 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:43:42.738945 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:43:42.738945 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:43:42.738945 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:43:42.738945 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:43:42.738945 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:43:42.738945 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:43:42.738945 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:43:42.738945 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1c8ed71-ea21-4bca-91bf-febe7457300e could not be found. Aug 01 16:43:42.738945 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:43:42.741288 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-063ed49c-e598-4f95-bd5f-10ceb05bb727 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Returning 404 to user: Instance f1c8ed71-ea21-4bca-91bf-febe7457300e could not be found. {{(pid=118118) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:43:42.741288 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-063ed49c-e598-4f95-bd5f-10ceb05bb727 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 404 len: 111 microversion: 2.20 time: 0.081209 Aug 01 16:43:42.747154 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-a0b894d2-fab3-4516-8246-dcc35b918ae3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '.version_select at 0x7efd5ecb7280>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:42.760115 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 316/622] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:43:42 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 01 16:43:42.794571 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-a0b894d2-fab3-4516-8246-dcc35b918ae3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-811461864" status: 204 len: 0 microversion: 2.20 time: 0.051588 Aug 01 16:43:42.795737 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 307/623] 10.222.0.45 () {60 vars in 1259 bytes} [Mon Aug 1 16:43:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-811461864 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 01 16:43:42.893340 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-b37e1077-df0f-4760-be32-798109a3ec21 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:42.894017 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-b37e1077-df0f-4760-be32-798109a3ec21 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: a3f6b512-e3cb-4e87-8d82-c64f6f1640db] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:42.901325 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-b37e1077-df0f-4760-be32-798109a3ec21 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:42.901855 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-b37e1077-df0f-4760-be32-798109a3ec21 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:42.902873 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-b37e1077-df0f-4760-be32-798109a3ec21 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:42.903494 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-b37e1077-df0f-4760-be32-798109a3ec21 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:43.201752 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-b37e1077-df0f-4760-be32-798109a3ec21 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0aed0278344119aae6906f4f52b1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b66d46c3e7d42b88f2dbdc01232fb03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:43.223725 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-b37e1077-df0f-4760-be32-798109a3ec21 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db" status: 200 len: 1671 microversion: 2.1 time: 0.336784 Aug 01 16:43:43.242054 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 317/624] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:43:42 2022] GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db => generated 1671 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:43:43.478595 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-b262184b-0399-41cc-9281-9146619f20fe tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:43.480337 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-b262184b-0399-41cc-9281-9146619f20fe tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] [instance: 45745fab-4299-4cef-a04a-619855e55336] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:43.490800 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-b262184b-0399-41cc-9281-9146619f20fe tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:43.491364 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-b262184b-0399-41cc-9281-9146619f20fe tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:43.492461 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-b262184b-0399-41cc-9281-9146619f20fe tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:43.492905 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-b262184b-0399-41cc-9281-9146619f20fe tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:43.731980 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-e38ba3cc-62eb-4c5c-bad0-b9fbeb871bff tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:43.732562 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-e38ba3cc-62eb-4c5c-bad0-b9fbeb871bff tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: 87f86dcf-be4f-4fb9-9957-d2c5c10d999c] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:43.739982 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-e38ba3cc-62eb-4c5c-bad0-b9fbeb871bff tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:43.740404 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-e38ba3cc-62eb-4c5c-bad0-b9fbeb871bff tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:43.741687 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-e38ba3cc-62eb-4c5c-bad0-b9fbeb871bff tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:43.742118 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-e38ba3cc-62eb-4c5c-bad0-b9fbeb871bff tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:43.946047 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-b262184b-0399-41cc-9281-9146619f20fe tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22cfd17a6f434deca7ef77253ae3ed2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86fcc5e23854dfba97058deac8211d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:43.954725 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-b262184b-0399-41cc-9281-9146619f20fe tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] 10.222.0.45 "GET /compute/v2.1/servers/45745fab-4299-4cef-a04a-619855e55336" status: 200 len: 1199 microversion: 2.1 time: 0.488277 Aug 01 16:43:43.955425 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 308/625] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:43:43 2022] GET /compute/v2.1/servers/45745fab-4299-4cef-a04a-619855e55336 => generated 1199 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:43:44.245875 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-94676503-22ee-43a8-8f41-329fad5e5ba7 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:44.246953 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-94676503-22ee-43a8-8f41-329fad5e5ba7 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: a3f6b512-e3cb-4e87-8d82-c64f6f1640db] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:44.248131 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-e38ba3cc-62eb-4c5c-bad0-b9fbeb871bff tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:44.255181 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-94676503-22ee-43a8-8f41-329fad5e5ba7 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:44.255982 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-94676503-22ee-43a8-8f41-329fad5e5ba7 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:44.256989 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-94676503-22ee-43a8-8f41-329fad5e5ba7 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:44.257623 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-94676503-22ee-43a8-8f41-329fad5e5ba7 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:44.260082 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-e38ba3cc-62eb-4c5c-bad0-b9fbeb871bff tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c" status: 200 len: 1737 microversion: 2.1 time: 0.532007 Aug 01 16:43:44.273111 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 318/626] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:43:43 2022] GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c => generated 1737 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:43:44.730145 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-94676503-22ee-43a8-8f41-329fad5e5ba7 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0aed0278344119aae6906f4f52b1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b66d46c3e7d42b88f2dbdc01232fb03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:44.733117 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:43:44.741409 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-94676503-22ee-43a8-8f41-329fad5e5ba7 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db" status: 200 len: 1671 microversion: 2.1 time: 0.499784 Aug 01 16:43:44.742137 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 309/627] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:43:44 2022] GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db => generated 1671 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:43:44.800988 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-232719df-37d3-498a-bb27-5f7a4eefdd13 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Action: 'create', calling method: .version_select at 0x7efd5ece94c0>, body: {"keypair": {"name": "tempest-keypair-1285065809", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG1gzqkFiXwqMwNHSF2BdMEcFVwxAl2VJjULtkFCkUMd4Puz57nLIxynGRJdwCd4Rbi7vdKR/3EzurUyn+XO5WY0TeZb3hkW+W7JZwybAU3Aj4lL2XPIVW80ZPAgTn3Q8w=="}} {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:43:44.830891 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.quota [None req-232719df-37d3-498a-bb27-5f7a4eefdd13 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Getting quotas for project 4c1c9729df694f46987e6dd30a09d5d2. Resources: {'key_pairs'} {{(pid=118118) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 16:43:44.837024 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.quota [None req-232719df-37d3-498a-bb27-5f7a4eefdd13 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Getting quotas for user 76c1fab92b854cd8937cc80818159191 and project 4c1c9729df694f46987e6dd30a09d5d2. Resources: {'key_pairs'} {{(pid=118118) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 16:43:44.868599 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-232719df-37d3-498a-bb27-5f7a4eefdd13 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.073504 Aug 01 16:43:44.870174 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 319/628] 10.222.0.45 () {62 vars in 1200 bytes} [Mon Aug 1 16:43:44 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 76 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 01 16:43:44.983066 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-c0544b68-10aa-4faf-a4d0-b5291e5184bf tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:44.983677 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-c0544b68-10aa-4faf-a4d0-b5291e5184bf tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] [instance: 45745fab-4299-4cef-a04a-619855e55336] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:44.992991 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-c0544b68-10aa-4faf-a4d0-b5291e5184bf tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:44.993399 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-c0544b68-10aa-4faf-a4d0-b5291e5184bf tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:44.994470 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-c0544b68-10aa-4faf-a4d0-b5291e5184bf tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:44.995333 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-c0544b68-10aa-4faf-a4d0-b5291e5184bf tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:45.286018 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-cecdebcd-00b9-4d01-ad62-bf81ee859774 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:45.286879 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-cecdebcd-00b9-4d01-ad62-bf81ee859774 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: 87f86dcf-be4f-4fb9-9957-d2c5c10d999c] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:45.303293 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-cecdebcd-00b9-4d01-ad62-bf81ee859774 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:45.305023 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-cecdebcd-00b9-4d01-ad62-bf81ee859774 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:45.306200 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-cecdebcd-00b9-4d01-ad62-bf81ee859774 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:45.306973 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-cecdebcd-00b9-4d01-ad62-bf81ee859774 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:45.443701 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-c0544b68-10aa-4faf-a4d0-b5291e5184bf tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22cfd17a6f434deca7ef77253ae3ed2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86fcc5e23854dfba97058deac8211d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:45.464653 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-c0544b68-10aa-4faf-a4d0-b5291e5184bf tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] 10.222.0.45 "GET /compute/v2.1/servers/45745fab-4299-4cef-a04a-619855e55336" status: 200 len: 1267 microversion: 2.1 time: 0.491301 Aug 01 16:43:45.465741 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 310/629] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:43:44 2022] GET /compute/v2.1/servers/45745fab-4299-4cef-a04a-619855e55336 => generated 1267 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:43:45.763887 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-550c7fbc-6bb9-49b5-838f-5b1086eace65 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:45.765275 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-550c7fbc-6bb9-49b5-838f-5b1086eace65 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: a3f6b512-e3cb-4e87-8d82-c64f6f1640db] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:45.775799 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-550c7fbc-6bb9-49b5-838f-5b1086eace65 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:45.776566 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-550c7fbc-6bb9-49b5-838f-5b1086eace65 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:45.777533 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-550c7fbc-6bb9-49b5-838f-5b1086eace65 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:45.778130 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-550c7fbc-6bb9-49b5-838f-5b1086eace65 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:45.902124 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-cecdebcd-00b9-4d01-ad62-bf81ee859774 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:45.913224 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-cecdebcd-00b9-4d01-ad62-bf81ee859774 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c" status: 200 len: 1737 microversion: 2.1 time: 0.631716 Aug 01 16:43:45.928243 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 320/630] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:43:45 2022] GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c => generated 1737 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:43:45.978153 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-550c7fbc-6bb9-49b5-838f-5b1086eace65 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0aed0278344119aae6906f4f52b1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b66d46c3e7d42b88f2dbdc01232fb03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:45.997207 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-550c7fbc-6bb9-49b5-838f-5b1086eace65 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db" status: 200 len: 1603 microversion: 2.1 time: 0.237189 Aug 01 16:43:45.998122 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 311/631] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:43:45 2022] GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db => generated 1603 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:43:46.494611 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-ddfc5bd2-489a-48a7-9f45-6ecf607d7102 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:46.495610 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-ddfc5bd2-489a-48a7-9f45-6ecf607d7102 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] [instance: 45745fab-4299-4cef-a04a-619855e55336] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:46.521109 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-ddfc5bd2-489a-48a7-9f45-6ecf607d7102 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:46.523585 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-ddfc5bd2-489a-48a7-9f45-6ecf607d7102 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:46.532328 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-ddfc5bd2-489a-48a7-9f45-6ecf607d7102 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:46.533038 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-ddfc5bd2-489a-48a7-9f45-6ecf607d7102 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:46.614541 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [req-d55a33be-2936-40e9-ba9c-1247b51cbf42 req-777e09c8-e82d-4158-a037-2ef379b52737 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3f6b512-e3cb-4e87-8d82-c64f6f1640db", "name": "network-vif-deleted", "tag": "6a20ac6a-706d-492a-a5e3-62c35c931aa8"}]} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:43:46.651258 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-d55a33be-2936-40e9-ba9c-1247b51cbf42 req-777e09c8-e82d-4158-a037-2ef379b52737 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:46.651624 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-d55a33be-2936-40e9-ba9c-1247b51cbf42 req-777e09c8-e82d-4158-a037-2ef379b52737 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:46.673180 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.compute.server_external_events [req-d55a33be-2936-40e9-ba9c-1247b51cbf42 req-777e09c8-e82d-4158-a037-2ef379b52737 service nova] Creating event network-vif-deleted:6a20ac6a-706d-492a-a5e3-62c35c931aa8 for instance a3f6b512-e3cb-4e87-8d82-c64f6f1640db on hv-cinder-85032 Aug 01 16:43:46.696942 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [req-d55a33be-2936-40e9-ba9c-1247b51cbf42 req-777e09c8-e82d-4158-a037-2ef379b52737 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086073 Aug 01 16:43:46.698137 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 312/632] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:43:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:43:46.886683 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-ddfc5bd2-489a-48a7-9f45-6ecf607d7102 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22cfd17a6f434deca7ef77253ae3ed2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86fcc5e23854dfba97058deac8211d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:46.904980 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-ddfc5bd2-489a-48a7-9f45-6ecf607d7102 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] 10.222.0.45 "GET /compute/v2.1/servers/45745fab-4299-4cef-a04a-619855e55336" status: 200 len: 1267 microversion: 2.1 time: 0.414177 Aug 01 16:43:46.905598 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 321/633] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:43:46 2022] GET /compute/v2.1/servers/45745fab-4299-4cef-a04a-619855e55336 => generated 1267 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:43:46.937121 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-44a317b6-79c5-44d1-b0c7-73c125863e83 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:46.937121 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-44a317b6-79c5-44d1-b0c7-73c125863e83 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: 87f86dcf-be4f-4fb9-9957-d2c5c10d999c] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:46.953497 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-44a317b6-79c5-44d1-b0c7-73c125863e83 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:46.953939 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-44a317b6-79c5-44d1-b0c7-73c125863e83 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:46.954718 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-44a317b6-79c5-44d1-b0c7-73c125863e83 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:46.955159 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-44a317b6-79c5-44d1-b0c7-73c125863e83 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:47.019405 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-98e61799-22b2-413b-8c59-1d3433541b34 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:47.020567 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-98e61799-22b2-413b-8c59-1d3433541b34 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: a3f6b512-e3cb-4e87-8d82-c64f6f1640db] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:47.036764 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-98e61799-22b2-413b-8c59-1d3433541b34 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:47.037727 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-98e61799-22b2-413b-8c59-1d3433541b34 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:47.039240 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-98e61799-22b2-413b-8c59-1d3433541b34 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:47.040421 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-98e61799-22b2-413b-8c59-1d3433541b34 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:47.132014 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-98e61799-22b2-413b-8c59-1d3433541b34 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:47.132633 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-98e61799-22b2-413b-8c59-1d3433541b34 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:47.133319 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.objects.instance [None req-98e61799-22b2-413b-8c59-1d3433541b34 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lazy-loading 'fault' on Instance uuid a3f6b512-e3cb-4e87-8d82-c64f6f1640db {{(pid=118118) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 16:43:47.260062 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-98e61799-22b2-413b-8c59-1d3433541b34 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0aed0278344119aae6906f4f52b1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b66d46c3e7d42b88f2dbdc01232fb03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:47.286964 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-98e61799-22b2-413b-8c59-1d3433541b34 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db" status: 200 len: 1326 microversion: 2.1 time: 0.269216 Aug 01 16:43:47.287991 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 322/634] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:43:47 2022] GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db => generated 1326 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:43:47.758906 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-44a317b6-79c5-44d1-b0c7-73c125863e83 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:47.771564 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-44a317b6-79c5-44d1-b0c7-73c125863e83 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c" status: 200 len: 1737 microversion: 2.1 time: 0.837784 Aug 01 16:43:47.786242 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 313/635] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:43:46 2022] GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c => generated 1737 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:43:47.934547 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-9d22c97e-707d-499a-8261-4405404156f6 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:47.935164 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-9d22c97e-707d-499a-8261-4405404156f6 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] [instance: 45745fab-4299-4cef-a04a-619855e55336] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:47.943875 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-9d22c97e-707d-499a-8261-4405404156f6 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:47.944183 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-9d22c97e-707d-499a-8261-4405404156f6 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:47.944967 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-9d22c97e-707d-499a-8261-4405404156f6 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:47.947434 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-9d22c97e-707d-499a-8261-4405404156f6 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:48.310426 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-29d207ca-d3e2-489f-9d79-dc707038b77a tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:48.311296 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-29d207ca-d3e2-489f-9d79-dc707038b77a tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: a3f6b512-e3cb-4e87-8d82-c64f6f1640db] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:48.320857 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-29d207ca-d3e2-489f-9d79-dc707038b77a tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:48.321789 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-29d207ca-d3e2-489f-9d79-dc707038b77a tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:48.323570 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-29d207ca-d3e2-489f-9d79-dc707038b77a tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:48.324115 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-29d207ca-d3e2-489f-9d79-dc707038b77a tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:48.344010 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.wsgi [None req-29d207ca-d3e2-489f-9d79-dc707038b77a tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] HTTP exception thrown: Instance a3f6b512-e3cb-4e87-8d82-c64f6f1640db could not be found. Aug 01 16:43:48.345684 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-29d207ca-d3e2-489f-9d79-dc707038b77a tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Request method failure captured: Aug 01 16:43:48.345684 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: request: GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db HTTP/1.1 Aug 01 16:43:48.345684 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Accept: application/json Aug 01 16:43:48.345684 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Accept-Encoding: identity Aug 01 16:43:48.345684 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Connection: close Aug 01 16:43:48.345684 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Content-Length: 0 Aug 01 16:43:48.345684 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Content-Type: application/json Aug 01 16:43:48.345684 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Host: 10.222.0.45 Aug 01 16:43:48.345684 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Openstack-System-Scope: None Aug 01 16:43:48.345684 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: User-Agent: python-urllib3/1.26.10 Aug 01 16:43:48.345684 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Auth-Token: gAAAAABi6AGyF0jsgYFh-A6y8l3Cn9YYm_pAkGAEG5bnQ2lr6MMYmVbqcoHdLrdkj9hZOvDEvf13Fnl9l68PRDdoffNcGLU3Am-BrhB1pdShu1fwRtyPe5h2ZeKYs1SoojvhOtT0OwtQA3DtUTyNaoSEKCj_5NgMhJf8Ty6o-I__-y_6ux_RLAg Aug 01 16:43:48.345684 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Domain-Id: None Aug 01 16:43:48.345684 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Domain-Name: None Aug 01 16:43:48.345684 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Identity-Status: Confirmed Aug 01 16:43:48.345684 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Is-Admin-Project: True Aug 01 16:43:48.345684 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Domain-Id: default Aug 01 16:43:48.345684 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Domain-Name: Default Aug 01 16:43:48.345684 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Id: 1b66d46c3e7d42b88f2dbdc01232fb03 Aug 01 16:43:48.345684 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Name: tempest-AttachVolumeTestJSON-231018232 Aug 01 16:43:48.345684 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Role: reader,member Aug 01 16:43:48.345684 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Roles: reader,member Aug 01 16:43:48.347268 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_1b66d46c3e7d42b88f2dbdc01232fb03"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/1b66d46c3e7d42b88f2dbdc01232fb03"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1b66d46c3e7d42b88f2dbdc01232fb03"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1b66d46c3e7d42b88f2dbdc01232fb03"}]}] Aug 01 16:43:48.347268 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Tenant: tempest-AttachVolumeTestJSON-231018232 Aug 01 16:43:48.347268 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Tenant-Id: 1b66d46c3e7d42b88f2dbdc01232fb03 Aug 01 16:43:48.347268 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Tenant-Name: tempest-AttachVolumeTestJSON-231018232 Aug 01 16:43:48.347268 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User: tempest-AttachVolumeTestJSON-231018232-project Aug 01 16:43:48.347268 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Domain-Id: default Aug 01 16:43:48.347268 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Domain-Name: Default Aug 01 16:43:48.347268 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Id: 4b0aed0278344119aae6906f4f52b1e5 Aug 01 16:43:48.347268 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Name: tempest-AttachVolumeTestJSON-231018232-project Aug 01 16:43:48.347268 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: method: > Aug 01 16:43:48.347268 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: exception: Instance a3f6b512-e3cb-4e87-8d82-c64f6f1640db could not be found. Aug 01 16:43:48.347268 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: action_args: {'id': 'a3f6b512-e3cb-4e87-8d82-c64f6f1640db'} Aug 01 16:43:48.348213 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:43:48.348213 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:43:48.348213 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 16:43:48.348213 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 16:43:48.348213 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 16:43:48.348213 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 16:43:48.348213 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 16:43:48.348213 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 16:43:48.348213 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 16:43:48.348213 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 16:43:48.348213 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3f6b512-e3cb-4e87-8d82-c64f6f1640db could not be found. Aug 01 16:43:48.348213 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:43:48.348213 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:43:48.348213 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:43:48.348213 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:43:48.348213 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:43:48.348213 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:43:48.348213 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:43:48.348213 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:43:48.348213 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:43:48.349495 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:43:48.349495 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 16:43:48.349495 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 16:43:48.349495 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 16:43:48.349495 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 16:43:48.349495 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 16:43:48.349495 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:43:48.349495 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3f6b512-e3cb-4e87-8d82-c64f6f1640db could not be found. Aug 01 16:43:48.349495 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:43:48.349495 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:43:48.349495 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:43:48.349495 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:43:48.349495 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:43:48.349495 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:43:48.349495 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:43:48.349495 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:43:48.349495 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3f6b512-e3cb-4e87-8d82-c64f6f1640db could not be found. Aug 01 16:43:48.349495 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:43:48.351984 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-29d207ca-d3e2-489f-9d79-dc707038b77a tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Returning 404 to user: Instance a3f6b512-e3cb-4e87-8d82-c64f6f1640db could not be found. {{(pid=118117) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:43:48.352912 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-29d207ca-d3e2-489f-9d79-dc707038b77a tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db" status: 404 len: 111 microversion: 2.1 time: 0.047410 Aug 01 16:43:48.353754 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 314/636] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:43:48 2022] GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 16:43:48.362755 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-69c27ce6-2d64-42ac-a4a2-e3bb6c4c090f tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '.version_select at 0x7efd5ea62a60>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:48.386524 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-69c27ce6-2d64-42ac-a4a2-e3bb6c4c090f tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-722654932" status: 202 len: 0 microversion: 2.1 time: 0.027627 Aug 01 16:43:48.391432 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 315/637] 10.222.0.45 () {58 vars in 1218 bytes} [Mon Aug 1 16:43:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-722654932 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 16:43:48.429209 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-9d22c97e-707d-499a-8261-4405404156f6 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22cfd17a6f434deca7ef77253ae3ed2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86fcc5e23854dfba97058deac8211d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:48.437396 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-9d22c97e-707d-499a-8261-4405404156f6 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] 10.222.0.45 "GET /compute/v2.1/servers/45745fab-4299-4cef-a04a-619855e55336" status: 200 len: 1267 microversion: 2.1 time: 0.507208 Aug 01 16:43:48.438053 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 323/638] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:43:47 2022] GET /compute/v2.1/servers/45745fab-4299-4cef-a04a-619855e55336 => generated 1267 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:43:48.725203 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [req-4ed11466-5078-4717-9e46-6f9e8c8ecf70 req-dd029844-14e1-466a-a808-aaf9112edb7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45745fab-4299-4cef-a04a-619855e55336", "tag": "11c59797-892f-4432-9ed5-d068c34e65d5"}]} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:43:48.743434 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-4ed11466-5078-4717-9e46-6f9e8c8ecf70 req-dd029844-14e1-466a-a808-aaf9112edb7d service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:48.744000 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-4ed11466-5078-4717-9e46-6f9e8c8ecf70 req-dd029844-14e1-466a-a808-aaf9112edb7d service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:48.756332 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.compute.server_external_events [req-4ed11466-5078-4717-9e46-6f9e8c8ecf70 req-dd029844-14e1-466a-a808-aaf9112edb7d service nova] Creating event network-changed:11c59797-892f-4432-9ed5-d068c34e65d5 for instance 45745fab-4299-4cef-a04a-619855e55336 on hv-cinder-85032 Aug 01 16:43:48.762202 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [req-4ed11466-5078-4717-9e46-6f9e8c8ecf70 req-dd029844-14e1-466a-a808-aaf9112edb7d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042666 Aug 01 16:43:48.763221 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 316/639] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:43:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 16:43:48.794915 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-f71655dd-cbc6-427b-baf3-6d6455d2c491 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:48.795527 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-f71655dd-cbc6-427b-baf3-6d6455d2c491 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: 87f86dcf-be4f-4fb9-9957-d2c5c10d999c] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:48.802021 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-f71655dd-cbc6-427b-baf3-6d6455d2c491 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:48.803872 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-f71655dd-cbc6-427b-baf3-6d6455d2c491 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:48.804881 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-f71655dd-cbc6-427b-baf3-6d6455d2c491 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:48.805387 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-f71655dd-cbc6-427b-baf3-6d6455d2c491 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:49.155898 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-f71655dd-cbc6-427b-baf3-6d6455d2c491 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:49.165017 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-f71655dd-cbc6-427b-baf3-6d6455d2c491 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c" status: 200 len: 1737 microversion: 2.1 time: 0.374198 Aug 01 16:43:49.165855 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 324/640] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:43:48 2022] GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c => generated 1737 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:43:49.460282 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-396b8673-dfa9-4d8e-af66-f85de1527129 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:49.461028 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-396b8673-dfa9-4d8e-af66-f85de1527129 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] [instance: 45745fab-4299-4cef-a04a-619855e55336] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:49.468414 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-396b8673-dfa9-4d8e-af66-f85de1527129 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:49.469207 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-396b8673-dfa9-4d8e-af66-f85de1527129 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:49.470211 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-396b8673-dfa9-4d8e-af66-f85de1527129 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:49.470792 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-396b8673-dfa9-4d8e-af66-f85de1527129 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:49.520399 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_cell0:SELECT=2 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:43:49.537436 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-2051b9dd-2d24-42ee-aa70-102f3f5b6487 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-157546015", "imageRef": "c9cb5329-85cb-4472-935d-c4ea1d1f0592", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c367df93-8449-4ce9-84c8-05f8c630c096"}], "security_groups": [{"name": "tempest-securitygroup--187730965"}], "key_name": "tempest-keypair-1285065809", "user_data": "}} {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:43:49.552346 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_cell0:SELECT=6 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:43:49.700879 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-396b8673-dfa9-4d8e-af66-f85de1527129 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22cfd17a6f434deca7ef77253ae3ed2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86fcc5e23854dfba97058deac8211d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:49.709732 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-396b8673-dfa9-4d8e-af66-f85de1527129 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] 10.222.0.45 "GET /compute/v2.1/servers/45745fab-4299-4cef-a04a-619855e55336" status: 200 len: 1267 microversion: 2.1 time: 0.254070 Aug 01 16:43:49.710347 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 317/641] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:43:49 2022] GET /compute/v2.1/servers/45745fab-4299-4cef-a04a-619855e55336 => generated 1267 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:43:49.716086 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-fea1fd16-7c56-4671-a7e1-4546e05a54cf tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Action: 'create', calling method: .version_select at 0x7efd5ea4aaf0>, body: {"keypair": {"name": "tempest-keypair-375118878", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGBdttexLFsUD4zMo1j4lWC2uqv3mbpDV4zPdDj9x1Eylp7zhqDvUMfXjJVqdOnyO3siAEO2HPpxhxIXDNm3J2Panh5wXJRlGxMyixwdGIL8NiWg6tzDnVyVXKY34ZUiUA=="}} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:43:49.740319 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.network.neutron [None req-2051b9dd-2d24-42ee-aa70-102f3f5b6487 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] validate_networks() for [('c367df93-8449-4ce9-84c8-05f8c630c096', None, None, None, None, None)] {{(pid=118118) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 16:43:49.748582 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.quota [None req-fea1fd16-7c56-4671-a7e1-4546e05a54cf tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Getting quotas for project 1b66d46c3e7d42b88f2dbdc01232fb03. Resources: {'key_pairs'} {{(pid=118117) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 16:43:49.755936 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.quota [None req-fea1fd16-7c56-4671-a7e1-4546e05a54cf tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Getting quotas for user 4b0aed0278344119aae6906f4f52b1e5 and project 1b66d46c3e7d42b88f2dbdc01232fb03. Resources: {'key_pairs'} {{(pid=118117) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 16:43:49.815462 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-fea1fd16-7c56-4671-a7e1-4546e05a54cf tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.103151 Aug 01 16:43:49.817108 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 318/642] 10.222.0.45 () {60 vars in 1159 bytes} [Mon Aug 1 16:43:49 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:43:50.196299 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-b1eecf1a-ee70-4df5-ba47-9b6ddb8fe236 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:50.197245 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-b1eecf1a-ee70-4df5-ba47-9b6ddb8fe236 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: 87f86dcf-be4f-4fb9-9957-d2c5c10d999c] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:50.210346 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-b1eecf1a-ee70-4df5-ba47-9b6ddb8fe236 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:50.211162 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-b1eecf1a-ee70-4df5-ba47-9b6ddb8fe236 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:50.212121 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-b1eecf1a-ee70-4df5-ba47-9b6ddb8fe236 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:50.212957 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-b1eecf1a-ee70-4df5-ba47-9b6ddb8fe236 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:50.535062 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-b1eecf1a-ee70-4df5-ba47-9b6ddb8fe236 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:50.544729 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-b1eecf1a-ee70-4df5-ba47-9b6ddb8fe236 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c" status: 200 len: 1737 microversion: 2.1 time: 0.355983 Aug 01 16:43:50.545965 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 319/643] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:43:50 2022] GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c => generated 1737 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:43:50.553363 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.virt.hardware [None req-2051b9dd-2d24-42ee-aa70-102f3f5b6487 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Flavor limits 0:0:0 {{(pid=118118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 16:43:50.555064 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.virt.hardware [None req-2051b9dd-2d24-42ee-aa70-102f3f5b6487 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Image limits 0:0:0 {{(pid=118118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 16:43:50.555692 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.virt.hardware [None req-2051b9dd-2d24-42ee-aa70-102f3f5b6487 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Flavor pref 0:0:0 {{(pid=118118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 16:43:50.556284 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.virt.hardware [None req-2051b9dd-2d24-42ee-aa70-102f3f5b6487 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Image pref 0:0:0 {{(pid=118118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 16:43:50.557985 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.virt.hardware [None req-2051b9dd-2d24-42ee-aa70-102f3f5b6487 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 16:43:50.567833 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-2051b9dd-2d24-42ee-aa70-102f3f5b6487 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:50.568251 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-2051b9dd-2d24-42ee-aa70-102f3f5b6487 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:50.569049 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-2051b9dd-2d24-42ee-aa70-102f3f5b6487 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:50.569524 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-2051b9dd-2d24-42ee-aa70-102f3f5b6487 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:50.593407 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.quota [None req-2051b9dd-2d24-42ee-aa70-102f3f5b6487 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Getting quotas for project 4c1c9729df694f46987e6dd30a09d5d2. Resources: {'cores', 'ram', 'instances'} {{(pid=118118) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 16:43:50.597850 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.quota [None req-2051b9dd-2d24-42ee-aa70-102f3f5b6487 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Getting quotas for user 76c1fab92b854cd8937cc80818159191 and project 4c1c9729df694f46987e6dd30a09d5d2. Resources: {'cores', 'ram', 'instances'} {{(pid=118118) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 16:43:50.609887 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-2051b9dd-2d24-42ee-aa70-102f3f5b6487 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Going to run 1 instances... {{(pid=118118) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 16:43:50.612198 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-2051b9dd-2d24-42ee-aa70-102f3f5b6487 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c9cb5329-85cb-4472-935d-c4ea1d1f0592',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118118) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 16:43:50.669279 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-2051b9dd-2d24-42ee-aa70-102f3f5b6487 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.141957 Aug 01 16:43:50.677780 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 325/644] 10.222.0.45 () {62 vars in 1188 bytes} [Mon Aug 1 16:43:49 2022] POST /compute/v2.1/servers => generated 401 bytes in 1144 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 01 16:43:50.682981 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-7ebefa69-24fd-434b-93ed-f0bdc25f50f7 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:50.683582 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-7ebefa69-24fd-434b-93ed-f0bdc25f50f7 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:50.741349 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-46dccf9e-46b4-4050-90f5-20faf4f74fe0 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:50.743706 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-46dccf9e-46b4-4050-90f5-20faf4f74fe0 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] [instance: 45745fab-4299-4cef-a04a-619855e55336] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:50.758337 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-46dccf9e-46b4-4050-90f5-20faf4f74fe0 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:50.759477 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-46dccf9e-46b4-4050-90f5-20faf4f74fe0 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:50.762920 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-46dccf9e-46b4-4050-90f5-20faf4f74fe0 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:50.764568 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-46dccf9e-46b4-4050-90f5-20faf4f74fe0 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:50.805813 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-7ebefa69-24fd-434b-93ed-f0bdc25f50f7 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:50.816763 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-7ebefa69-24fd-434b-93ed-f0bdc25f50f7 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:50.819088 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-7ebefa69-24fd-434b-93ed-f0bdc25f50f7 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:50.820618 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-7ebefa69-24fd-434b-93ed-f0bdc25f50f7 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926" status: 200 len: 1281 microversion: 2.20 time: 0.141726 Aug 01 16:43:50.821908 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 320/645] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:43:50 2022] GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926 => generated 1281 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:43:51.003006 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-46dccf9e-46b4-4050-90f5-20faf4f74fe0 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22cfd17a6f434deca7ef77253ae3ed2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86fcc5e23854dfba97058deac8211d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:51.022487 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-46dccf9e-46b4-4050-90f5-20faf4f74fe0 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] 10.222.0.45 "GET /compute/v2.1/servers/45745fab-4299-4cef-a04a-619855e55336" status: 200 len: 1267 microversion: 2.1 time: 0.290763 Aug 01 16:43:51.023086 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 326/646] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:43:50 2022] GET /compute/v2.1/servers/45745fab-4299-4cef-a04a-619855e55336 => generated 1267 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:43:51.476744 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-748e7655-f63c-402d-a34d-69d8e98d0446 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1081591454", "imageRef": "c9cb5329-85cb-4472-935d-c4ea1d1f0592", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c300be66-e5b5-45ad-b400-2cd95bf6b7d7"}], "security_groups": [{"name": "tempest-securitygroup--1271699086"}], "key_name": "tempest-keypair-375118878", "user_data": "}} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:43:51.569559 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-c537a5dd-14dd-4cc8-bb90-06ddee7698ee tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:51.570135 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-c537a5dd-14dd-4cc8-bb90-06ddee7698ee tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: 87f86dcf-be4f-4fb9-9957-d2c5c10d999c] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:51.578239 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-c537a5dd-14dd-4cc8-bb90-06ddee7698ee tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:51.578681 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-c537a5dd-14dd-4cc8-bb90-06ddee7698ee tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:51.579461 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-c537a5dd-14dd-4cc8-bb90-06ddee7698ee tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:51.579918 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-c537a5dd-14dd-4cc8-bb90-06ddee7698ee tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:51.592962 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.network.neutron [None req-748e7655-f63c-402d-a34d-69d8e98d0446 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] validate_networks() for [('c300be66-e5b5-45ad-b400-2cd95bf6b7d7', None, None, None, None, None)] {{(pid=118117) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 16:43:51.801174 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-c537a5dd-14dd-4cc8-bb90-06ddee7698ee tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:51.811485 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-c537a5dd-14dd-4cc8-bb90-06ddee7698ee tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c" status: 200 len: 1737 microversion: 2.1 time: 0.246764 Aug 01 16:43:51.812210 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 327/647] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:43:51 2022] GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c => generated 1737 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:43:51.844216 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-e924e283-2c2d-4744-b77e-d234c6458dcd tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:51.844926 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-e924e283-2c2d-4744-b77e-d234c6458dcd tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:51.847008 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:43:51.857251 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-e924e283-2c2d-4744-b77e-d234c6458dcd tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:51.860690 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-e924e283-2c2d-4744-b77e-d234c6458dcd tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:51.860690 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-e924e283-2c2d-4744-b77e-d234c6458dcd tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:51.860690 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-e924e283-2c2d-4744-b77e-d234c6458dcd tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:51.971585 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-e924e283-2c2d-4744-b77e-d234c6458dcd tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:51.983551 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-e924e283-2c2d-4744-b77e-d234c6458dcd tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:51.985443 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-e924e283-2c2d-4744-b77e-d234c6458dcd tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:51.986653 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-e924e283-2c2d-4744-b77e-d234c6458dcd tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926" status: 200 len: 1333 microversion: 2.20 time: 0.147421 Aug 01 16:43:51.987257 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 328/648] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:43:51 2022] GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926 => generated 1333 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:43:52.043876 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-71077463-1b95-47f9-a70e-896575108f06 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:52.044491 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-71077463-1b95-47f9-a70e-896575108f06 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] [instance: 45745fab-4299-4cef-a04a-619855e55336] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:52.050978 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-71077463-1b95-47f9-a70e-896575108f06 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:52.051420 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-71077463-1b95-47f9-a70e-896575108f06 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:52.052227 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-71077463-1b95-47f9-a70e-896575108f06 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:52.052654 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-71077463-1b95-47f9-a70e-896575108f06 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:52.156099 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.virt.hardware [None req-748e7655-f63c-402d-a34d-69d8e98d0446 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Flavor limits 0:0:0 {{(pid=118117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 16:43:52.156647 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.virt.hardware [None req-748e7655-f63c-402d-a34d-69d8e98d0446 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Image limits 0:0:0 {{(pid=118117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 16:43:52.157136 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.virt.hardware [None req-748e7655-f63c-402d-a34d-69d8e98d0446 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Flavor pref 0:0:0 {{(pid=118117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 16:43:52.157568 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.virt.hardware [None req-748e7655-f63c-402d-a34d-69d8e98d0446 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Image pref 0:0:0 {{(pid=118117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 16:43:52.157978 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.virt.hardware [None req-748e7655-f63c-402d-a34d-69d8e98d0446 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 16:43:52.167629 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-748e7655-f63c-402d-a34d-69d8e98d0446 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:52.168107 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-748e7655-f63c-402d-a34d-69d8e98d0446 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:52.168902 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-748e7655-f63c-402d-a34d-69d8e98d0446 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:52.169334 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-748e7655-f63c-402d-a34d-69d8e98d0446 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:52.188034 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.quota [None req-748e7655-f63c-402d-a34d-69d8e98d0446 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Getting quotas for project 1b66d46c3e7d42b88f2dbdc01232fb03. Resources: {'cores', 'ram', 'instances'} {{(pid=118117) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 16:43:52.192426 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.quota [None req-748e7655-f63c-402d-a34d-69d8e98d0446 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Getting quotas for user 4b0aed0278344119aae6906f4f52b1e5 and project 1b66d46c3e7d42b88f2dbdc01232fb03. Resources: {'cores', 'ram', 'instances'} {{(pid=118117) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 16:43:52.205402 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-748e7655-f63c-402d-a34d-69d8e98d0446 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Going to run 1 instances... {{(pid=118117) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 16:43:52.207250 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-748e7655-f63c-402d-a34d-69d8e98d0446 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: e2e46d25-15d6-4671-8d04-9994875a9f96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c9cb5329-85cb-4472-935d-c4ea1d1f0592',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118117) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 16:43:52.215145 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-71077463-1b95-47f9-a70e-896575108f06 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22cfd17a6f434deca7ef77253ae3ed2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86fcc5e23854dfba97058deac8211d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:52.224061 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-71077463-1b95-47f9-a70e-896575108f06 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] 10.222.0.45 "GET /compute/v2.1/servers/45745fab-4299-4cef-a04a-619855e55336" status: 200 len: 1267 microversion: 2.1 time: 0.184028 Aug 01 16:43:52.224973 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 329/649] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:43:52 2022] GET /compute/v2.1/servers/45745fab-4299-4cef-a04a-619855e55336 => generated 1267 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:43:52.261112 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-748e7655-f63c-402d-a34d-69d8e98d0446 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.788639 Aug 01 16:43:52.262062 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 321/650] 10.222.0.45 () {60 vars in 1147 bytes} [Mon Aug 1 16:43:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 790 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 16:43:52.275325 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-e883f7b4-3c8f-43c1-8cae-364f698a52bb tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:52.276432 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-e883f7b4-3c8f-43c1-8cae-364f698a52bb tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: e2e46d25-15d6-4671-8d04-9994875a9f96] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:52.366349 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-e883f7b4-3c8f-43c1-8cae-364f698a52bb tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0aed0278344119aae6906f4f52b1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b66d46c3e7d42b88f2dbdc01232fb03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:52.378085 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-e883f7b4-3c8f-43c1-8cae-364f698a52bb tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/e2e46d25-15d6-4671-8d04-9994875a9f96" status: 200 len: 1237 microversion: 2.1 time: 0.108268 Aug 01 16:43:52.391788 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 330/651] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:43:52 2022] GET /compute/v2.1/servers/e2e46d25-15d6-4671-8d04-9994875a9f96 => generated 1237 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:43:52.846209 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-ba170964-4051-42f1-b483-7c2583b48bf4 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:52.846854 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-ba170964-4051-42f1-b483-7c2583b48bf4 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: 87f86dcf-be4f-4fb9-9957-d2c5c10d999c] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:52.854877 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-ba170964-4051-42f1-b483-7c2583b48bf4 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:52.855579 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-ba170964-4051-42f1-b483-7c2583b48bf4 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:52.856646 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-ba170964-4051-42f1-b483-7c2583b48bf4 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:52.857294 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-ba170964-4051-42f1-b483-7c2583b48bf4 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:53.013635 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-239ec15b-6db3-49ef-8e82-a5e30c48b954 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:53.014977 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-239ec15b-6db3-49ef-8e82-a5e30c48b954 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:53.028876 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-239ec15b-6db3-49ef-8e82-a5e30c48b954 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:53.030452 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-239ec15b-6db3-49ef-8e82-a5e30c48b954 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:53.032222 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-239ec15b-6db3-49ef-8e82-a5e30c48b954 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:53.033270 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-239ec15b-6db3-49ef-8e82-a5e30c48b954 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:53.054258 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_cell1:SELECT=100 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:43:53.120940 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-ba170964-4051-42f1-b483-7c2583b48bf4 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:53.129397 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-ba170964-4051-42f1-b483-7c2583b48bf4 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c" status: 200 len: 1717 microversion: 2.1 time: 0.287614 Aug 01 16:43:53.129988 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 322/652] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:43:52 2022] GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c => generated 1717 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:43:53.145448 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-239ec15b-6db3-49ef-8e82-a5e30c48b954 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:53.160386 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-239ec15b-6db3-49ef-8e82-a5e30c48b954 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:53.163472 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-239ec15b-6db3-49ef-8e82-a5e30c48b954 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:53.165601 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-239ec15b-6db3-49ef-8e82-a5e30c48b954 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926" status: 200 len: 1339 microversion: 2.20 time: 0.157749 Aug 01 16:43:53.166893 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 331/653] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:43:53 2022] GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926 => generated 1339 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:43:53.261139 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-17094014-c6a7-48f3-a83d-a023faa410f6 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:53.263048 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-17094014-c6a7-48f3-a83d-a023faa410f6 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] [instance: 45745fab-4299-4cef-a04a-619855e55336] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:53.274906 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-17094014-c6a7-48f3-a83d-a023faa410f6 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:53.276242 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-17094014-c6a7-48f3-a83d-a023faa410f6 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:53.278395 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-17094014-c6a7-48f3-a83d-a023faa410f6 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:53.279354 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-17094014-c6a7-48f3-a83d-a023faa410f6 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:53.324761 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-3871deda-3bff-4eec-9475-2e6a903fd747 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:53.325568 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-3871deda-3bff-4eec-9475-2e6a903fd747 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: 87f86dcf-be4f-4fb9-9957-d2c5c10d999c] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:53.362122 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3871deda-3bff-4eec-9475-2e6a903fd747 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:53.364013 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3871deda-3bff-4eec-9475-2e6a903fd747 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:53.366500 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3871deda-3bff-4eec-9475-2e6a903fd747 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:53.367089 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3871deda-3bff-4eec-9475-2e6a903fd747 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:53.472885 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.wsgi [None req-3871deda-3bff-4eec-9475-2e6a903fd747 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] HTTP exception thrown: Cannot 'detach_volume' instance 87f86dcf-be4f-4fb9-9957-d2c5c10d999c while it is in vm_state rescued Aug 01 16:43:53.474854 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-3871deda-3bff-4eec-9475-2e6a903fd747 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Request method failure captured: Aug 01 16:43:53.474854 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: request: DELETE /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c/os-volume_attachments/fd05abf8-7d80-4794-aea2-328213fe337b HTTP/1.1 Aug 01 16:43:53.474854 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Accept: application/json Aug 01 16:43:53.474854 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Accept-Encoding: identity Aug 01 16:43:53.474854 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Connection: close Aug 01 16:43:53.474854 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Content-Length: 0 Aug 01 16:43:53.474854 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Content-Type: application/json Aug 01 16:43:53.474854 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Host: 10.222.0.45 Aug 01 16:43:53.474854 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Openstack-System-Scope: None Aug 01 16:43:53.474854 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: User-Agent: python-urllib3/1.26.10 Aug 01 16:43:53.474854 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Auth-Token: gAAAAABi6AHBHBBMxUjuAe-cwnK815X7ZxuzFHyHjtrk1uJot40PNHiBi2X9YMJeHWohQLbZQ5KLL_REXas2dwpv6zW97hCtQR9_HhjsDDAU83KRBYwvEJCNPLIcHZ71AIrAo_sj1b009gKLC_UwiqB_GoFhYRdPglged0gU-Y7E301TTJaBV1M Aug 01 16:43:53.474854 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Domain-Id: None Aug 01 16:43:53.474854 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Domain-Name: None Aug 01 16:43:53.474854 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Identity-Status: Confirmed Aug 01 16:43:53.474854 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Is-Admin-Project: True Aug 01 16:43:53.474854 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Domain-Id: default Aug 01 16:43:53.474854 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Domain-Name: Default Aug 01 16:43:53.474854 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Id: dbd6814591334db58a37092eb04729fb Aug 01 16:43:53.474854 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1899232052 Aug 01 16:43:53.474854 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Role: reader,member Aug 01 16:43:53.474854 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Roles: reader,member Aug 01 16:43:53.476306 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_dbd6814591334db58a37092eb04729fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/dbd6814591334db58a37092eb04729fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/dbd6814591334db58a37092eb04729fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/dbd6814591334db58a37092eb04729fb"}]}] Aug 01 16:43:53.476306 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1899232052 Aug 01 16:43:53.476306 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant-Id: dbd6814591334db58a37092eb04729fb Aug 01 16:43:53.476306 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1899232052 Aug 01 16:43:53.476306 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User: tempest-ServerRescueNegativeTestJSON-1899232052-project Aug 01 16:43:53.476306 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Domain-Id: default Aug 01 16:43:53.476306 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Domain-Name: Default Aug 01 16:43:53.476306 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Id: 4294d6dff5054da7afcb37b8b28f1a01 Aug 01 16:43:53.476306 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1899232052-project Aug 01 16:43:53.476306 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: method: > Aug 01 16:43:53.476306 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: exception: Cannot 'detach_volume' instance 87f86dcf-be4f-4fb9-9957-d2c5c10d999c while it is in vm_state rescued Aug 01 16:43:53.477018 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: action_args: {'server_id': '87f86dcf-be4f-4fb9-9957-d2c5c10d999c', 'id': 'fd05abf8-7d80-4794-aea2-328213fe337b'} Aug 01 16:43:53.477018 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:43:53.477018 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:43:53.477018 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 01 16:43:53.477018 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 01 16:43:53.477018 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 01 16:43:53.477018 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 01 16:43:53.477018 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 01 16:43:53.477018 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 01 16:43:53.477018 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 87f86dcf-be4f-4fb9-9957-d2c5c10d999c in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 01 16:43:53.477018 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:43:53.477018 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:43:53.477018 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:43:53.477018 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:43:53.477018 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:43:53.477018 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:43:53.477018 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:43:53.477018 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:43:53.477018 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:43:53.477018 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:43:53.478210 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 01 16:43:53.478210 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 01 16:43:53.478210 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 01 16:43:53.478210 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 01 16:43:53.478210 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 87f86dcf-be4f-4fb9-9957-d2c5c10d999c while it is in vm_state rescued Aug 01 16:43:53.478210 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:43:53.478210 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:43:53.478210 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:43:53.478210 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:43:53.478210 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:43:53.478210 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:43:53.478210 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:43:53.478210 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:43:53.478210 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 87f86dcf-be4f-4fb9-9957-d2c5c10d999c while it is in vm_state rescued Aug 01 16:43:53.478210 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:43:53.480619 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-3871deda-3bff-4eec-9475-2e6a903fd747 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Returning 409 to user: Cannot 'detach_volume' instance 87f86dcf-be4f-4fb9-9957-d2c5c10d999c while it is in vm_state rescued {{(pid=118118) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:43:53.481523 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-3871deda-3bff-4eec-9475-2e6a903fd747 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "DELETE /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c/os-volume_attachments/fd05abf8-7d80-4794-aea2-328213fe337b" status: 409 len: 152 microversion: 2.1 time: 0.163887 Aug 01 16:43:53.485665 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 332/654] 10.222.0.45 () {58 vars in 1416 bytes} [Mon Aug 1 16:43:53 2022] DELETE /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c/os-volume_attachments/fd05abf8-7d80-4794-aea2-328213fe337b => generated 152 bytes in 167 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 01 16:43:53.488338 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-be39e8e8-2031-48d2-b35d-91ab77845bf3 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:53.489360 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-be39e8e8-2031-48d2-b35d-91ab77845bf3 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: e2e46d25-15d6-4671-8d04-9994875a9f96] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:53.497305 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-be39e8e8-2031-48d2-b35d-91ab77845bf3 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:53.498121 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-be39e8e8-2031-48d2-b35d-91ab77845bf3 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:53.499157 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-be39e8e8-2031-48d2-b35d-91ab77845bf3 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:53.500018 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-be39e8e8-2031-48d2-b35d-91ab77845bf3 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:53.886623 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-be39e8e8-2031-48d2-b35d-91ab77845bf3 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0aed0278344119aae6906f4f52b1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b66d46c3e7d42b88f2dbdc01232fb03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:53.894928 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-be39e8e8-2031-48d2-b35d-91ab77845bf3 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/e2e46d25-15d6-4671-8d04-9994875a9f96" status: 200 len: 1307 microversion: 2.1 time: 0.411216 Aug 01 16:43:53.907866 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 333/655] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:43:53 2022] GET /compute/v2.1/servers/e2e46d25-15d6-4671-8d04-9994875a9f96 => generated 1307 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:43:53.907866 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-39a6d526-399f-417f-9cc9-dcadb97eb3e3 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:43:53.907866 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-39a6d526-399f-417f-9cc9-dcadb97eb3e3 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: 87f86dcf-be4f-4fb9-9957-d2c5c10d999c] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:53.907866 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-39a6d526-399f-417f-9cc9-dcadb97eb3e3 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:53.908378 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-39a6d526-399f-417f-9cc9-dcadb97eb3e3 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:53.909129 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-39a6d526-399f-417f-9cc9-dcadb97eb3e3 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:53.909519 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-39a6d526-399f-417f-9cc9-dcadb97eb3e3 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:53.984822 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-39a6d526-399f-417f-9cc9-dcadb97eb3e3 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "POST /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c/action" status: 202 len: 0 microversion: 2.1 time: 0.087239 Aug 01 16:43:53.987974 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 334/656] 10.222.0.45 () {60 vars in 1278 bytes} [Mon Aug 1 16:43:53 2022] POST /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 16:43:53.994539 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-d3479283-b2e3-46f9-b2f3-b12312479685 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:53.995247 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-d3479283-b2e3-46f9-b2f3-b12312479685 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: 87f86dcf-be4f-4fb9-9957-d2c5c10d999c] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:54.001906 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-d3479283-b2e3-46f9-b2f3-b12312479685 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:54.002359 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-d3479283-b2e3-46f9-b2f3-b12312479685 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:54.003140 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-d3479283-b2e3-46f9-b2f3-b12312479685 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:54.003623 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-d3479283-b2e3-46f9-b2f3-b12312479685 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:54.022054 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-17094014-c6a7-48f3-a83d-a023faa410f6 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22cfd17a6f434deca7ef77253ae3ed2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86fcc5e23854dfba97058deac8211d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:54.034070 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-17094014-c6a7-48f3-a83d-a023faa410f6 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] 10.222.0.45 "GET /compute/v2.1/servers/45745fab-4299-4cef-a04a-619855e55336" status: 200 len: 1267 microversion: 2.1 time: 0.787724 Aug 01 16:43:54.036489 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 323/657] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:43:53 2022] GET /compute/v2.1/servers/45745fab-4299-4cef-a04a-619855e55336 => generated 1267 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:43:54.202841 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-4dd875e9-c000-4906-99f5-57cf8e6a9126 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:54.203466 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-4dd875e9-c000-4906-99f5-57cf8e6a9126 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:54.209947 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-4dd875e9-c000-4906-99f5-57cf8e6a9126 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:54.210645 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-4dd875e9-c000-4906-99f5-57cf8e6a9126 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:54.211589 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-4dd875e9-c000-4906-99f5-57cf8e6a9126 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:54.212046 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-4dd875e9-c000-4906-99f5-57cf8e6a9126 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:54.539910 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-d3479283-b2e3-46f9-b2f3-b12312479685 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:54.549398 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-d3479283-b2e3-46f9-b2f3-b12312479685 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c" status: 200 len: 1725 microversion: 2.1 time: 0.559338 Aug 01 16:43:54.549988 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 335/658] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:43:53 2022] GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c => generated 1725 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:43:54.739219 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-4dd875e9-c000-4906-99f5-57cf8e6a9126 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:54.748580 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-4dd875e9-c000-4906-99f5-57cf8e6a9126 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:54.750302 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-4dd875e9-c000-4906-99f5-57cf8e6a9126 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:54.751374 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-4dd875e9-c000-4906-99f5-57cf8e6a9126 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926" status: 200 len: 1406 microversion: 2.20 time: 0.553409 Aug 01 16:43:54.752370 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 324/659] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:43:54 2022] GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926 => generated 1406 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:43:54.918932 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-b788812f-d2fe-4501-91bd-aca1cb53a4c0 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:54.919635 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-b788812f-d2fe-4501-91bd-aca1cb53a4c0 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: e2e46d25-15d6-4671-8d04-9994875a9f96] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:54.926467 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-b788812f-d2fe-4501-91bd-aca1cb53a4c0 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:54.926902 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-b788812f-d2fe-4501-91bd-aca1cb53a4c0 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:54.927677 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-b788812f-d2fe-4501-91bd-aca1cb53a4c0 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:54.928183 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-b788812f-d2fe-4501-91bd-aca1cb53a4c0 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:55.055897 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-855d7bd4-dd43-4f11-8faf-2deefaa7bc22 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:55.056782 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-855d7bd4-dd43-4f11-8faf-2deefaa7bc22 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] [instance: 45745fab-4299-4cef-a04a-619855e55336] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:55.066431 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-855d7bd4-dd43-4f11-8faf-2deefaa7bc22 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:55.067199 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-855d7bd4-dd43-4f11-8faf-2deefaa7bc22 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:55.068546 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-855d7bd4-dd43-4f11-8faf-2deefaa7bc22 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:55.069027 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-b788812f-d2fe-4501-91bd-aca1cb53a4c0 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0aed0278344119aae6906f4f52b1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b66d46c3e7d42b88f2dbdc01232fb03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:55.070003 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-855d7bd4-dd43-4f11-8faf-2deefaa7bc22 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:55.083379 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-b788812f-d2fe-4501-91bd-aca1cb53a4c0 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/e2e46d25-15d6-4671-8d04-9994875a9f96" status: 200 len: 1295 microversion: 2.1 time: 0.167854 Aug 01 16:43:55.091834 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 336/660] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:43:54 2022] GET /compute/v2.1/servers/e2e46d25-15d6-4671-8d04-9994875a9f96 => generated 1295 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:43:55.550667 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-855d7bd4-dd43-4f11-8faf-2deefaa7bc22 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22cfd17a6f434deca7ef77253ae3ed2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86fcc5e23854dfba97058deac8211d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:55.561131 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-855d7bd4-dd43-4f11-8faf-2deefaa7bc22 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] 10.222.0.45 "GET /compute/v2.1/servers/45745fab-4299-4cef-a04a-619855e55336" status: 200 len: 1267 microversion: 2.1 time: 0.509102 Aug 01 16:43:55.561727 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 325/661] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:43:55 2022] GET /compute/v2.1/servers/45745fab-4299-4cef-a04a-619855e55336 => generated 1267 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:43:55.572300 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-f813873a-3c53-4bcf-863b-e108e87b73d1 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:55.573475 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-f813873a-3c53-4bcf-863b-e108e87b73d1 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: 87f86dcf-be4f-4fb9-9957-d2c5c10d999c] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:55.580079 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-f813873a-3c53-4bcf-863b-e108e87b73d1 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:55.580527 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-f813873a-3c53-4bcf-863b-e108e87b73d1 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:55.581305 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-f813873a-3c53-4bcf-863b-e108e87b73d1 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:55.581736 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-f813873a-3c53-4bcf-863b-e108e87b73d1 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:55.774710 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-f50c923b-457b-4136-9486-37f10090438a tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:55.775670 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-f50c923b-457b-4136-9486-37f10090438a tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:55.781984 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-f50c923b-457b-4136-9486-37f10090438a tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:55.782441 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-f50c923b-457b-4136-9486-37f10090438a tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:55.783388 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-f50c923b-457b-4136-9486-37f10090438a tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:55.783812 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-f50c923b-457b-4136-9486-37f10090438a tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:56.095335 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-f813873a-3c53-4bcf-863b-e108e87b73d1 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:56.105653 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-f813873a-3c53-4bcf-863b-e108e87b73d1 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c" status: 200 len: 1725 microversion: 2.1 time: 0.537705 Aug 01 16:43:56.106573 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 337/662] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:43:55 2022] GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c => generated 1725 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:43:56.111577 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [req-df2feb3c-fc53-48bf-9edd-0a45264f83c7 req-dd6e5c43-0df1-46b1-8f8c-b463c037a414 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "144c8e15-97cd-4e0d-9d60-2ba97c26e926", "tag": "4f59fd5b-8ef2-4634-a3a5-063fd9fa3526"}]} {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:43:56.123429 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-df2feb3c-fc53-48bf-9edd-0a45264f83c7 req-dd6e5c43-0df1-46b1-8f8c-b463c037a414 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:56.123975 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-df2feb3c-fc53-48bf-9edd-0a45264f83c7 req-dd6e5c43-0df1-46b1-8f8c-b463c037a414 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:56.139417 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.compute.server_external_events [req-df2feb3c-fc53-48bf-9edd-0a45264f83c7 req-dd6e5c43-0df1-46b1-8f8c-b463c037a414 service nova] Creating event network-changed:4f59fd5b-8ef2-4634-a3a5-063fd9fa3526 for instance 144c8e15-97cd-4e0d-9d60-2ba97c26e926 on hv-cinder-85032 Aug 01 16:43:56.146711 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [req-df2feb3c-fc53-48bf-9edd-0a45264f83c7 req-dd6e5c43-0df1-46b1-8f8c-b463c037a414 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038583 Aug 01 16:43:56.147816 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 338/663] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:43:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:43:56.157201 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-49d0d1c6-8599-4d4c-b1a8-f5afb61d7a03 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:56.157980 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-49d0d1c6-8599-4d4c-b1a8-f5afb61d7a03 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: e2e46d25-15d6-4671-8d04-9994875a9f96] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:56.168662 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-49d0d1c6-8599-4d4c-b1a8-f5afb61d7a03 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:56.169119 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-49d0d1c6-8599-4d4c-b1a8-f5afb61d7a03 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:56.170017 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-49d0d1c6-8599-4d4c-b1a8-f5afb61d7a03 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:56.176553 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-49d0d1c6-8599-4d4c-b1a8-f5afb61d7a03 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:56.231098 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-f50c923b-457b-4136-9486-37f10090438a tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:56.240446 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-f50c923b-457b-4136-9486-37f10090438a tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:56.242061 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-f50c923b-457b-4136-9486-37f10090438a tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:56.243263 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-f50c923b-457b-4136-9486-37f10090438a tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926" status: 200 len: 1406 microversion: 2.20 time: 0.472477 Aug 01 16:43:56.243986 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 326/664] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:43:55 2022] GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926 => generated 1406 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:43:56.453774 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-49d0d1c6-8599-4d4c-b1a8-f5afb61d7a03 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0aed0278344119aae6906f4f52b1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b66d46c3e7d42b88f2dbdc01232fb03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:56.462200 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-49d0d1c6-8599-4d4c-b1a8-f5afb61d7a03 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/e2e46d25-15d6-4671-8d04-9994875a9f96" status: 200 len: 1363 microversion: 2.1 time: 0.313006 Aug 01 16:43:56.462854 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 339/665] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:43:56 2022] GET /compute/v2.1/servers/e2e46d25-15d6-4671-8d04-9994875a9f96 => generated 1363 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:43:56.582852 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-a5dfc204-caab-4595-ae4d-c66386dfc9f2 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:56.583579 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-a5dfc204-caab-4595-ae4d-c66386dfc9f2 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] [instance: 45745fab-4299-4cef-a04a-619855e55336] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:56.590160 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-a5dfc204-caab-4595-ae4d-c66386dfc9f2 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:56.590676 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-a5dfc204-caab-4595-ae4d-c66386dfc9f2 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:56.591576 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-a5dfc204-caab-4595-ae4d-c66386dfc9f2 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:56.592189 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-a5dfc204-caab-4595-ae4d-c66386dfc9f2 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:56.820849 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-a5dfc204-caab-4595-ae4d-c66386dfc9f2 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22cfd17a6f434deca7ef77253ae3ed2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86fcc5e23854dfba97058deac8211d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:56.829989 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-a5dfc204-caab-4595-ae4d-c66386dfc9f2 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] 10.222.0.45 "GET /compute/v2.1/servers/45745fab-4299-4cef-a04a-619855e55336" status: 200 len: 1267 microversion: 2.1 time: 0.250775 Aug 01 16:43:56.830705 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 327/666] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:43:56 2022] GET /compute/v2.1/servers/45745fab-4299-4cef-a04a-619855e55336 => generated 1267 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:43:57.128502 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-3f5e7246-9273-4ae9-8f83-920bfb9a71a4 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:57.129097 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-3f5e7246-9273-4ae9-8f83-920bfb9a71a4 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: 87f86dcf-be4f-4fb9-9957-d2c5c10d999c] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:57.135918 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3f5e7246-9273-4ae9-8f83-920bfb9a71a4 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:57.136364 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3f5e7246-9273-4ae9-8f83-920bfb9a71a4 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:57.137134 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3f5e7246-9273-4ae9-8f83-920bfb9a71a4 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:57.137559 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3f5e7246-9273-4ae9-8f83-920bfb9a71a4 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:57.266716 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-90398d4b-dc37-4fc6-a32b-154f1788d604 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:57.267291 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-90398d4b-dc37-4fc6-a32b-154f1788d604 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:57.274121 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-90398d4b-dc37-4fc6-a32b-154f1788d604 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:57.274544 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-90398d4b-dc37-4fc6-a32b-154f1788d604 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:57.275680 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-90398d4b-dc37-4fc6-a32b-154f1788d604 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:57.276153 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-90398d4b-dc37-4fc6-a32b-154f1788d604 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:57.277647 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-3f5e7246-9273-4ae9-8f83-920bfb9a71a4 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:57.286284 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-3f5e7246-9273-4ae9-8f83-920bfb9a71a4 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c" status: 200 len: 1725 microversion: 2.1 time: 0.161702 Aug 01 16:43:57.287021 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 340/667] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:43:57 2022] GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:43:57.470217 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-90398d4b-dc37-4fc6-a32b-154f1788d604 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:57.481404 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-90398d4b-dc37-4fc6-a32b-154f1788d604 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:57.486434 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-6f9e1973-8251-4aa7-9c83-f66d4545e579 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:57.487057 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-6f9e1973-8251-4aa7-9c83-f66d4545e579 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: e2e46d25-15d6-4671-8d04-9994875a9f96] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:57.490540 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-90398d4b-dc37-4fc6-a32b-154f1788d604 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:57.491729 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-90398d4b-dc37-4fc6-a32b-154f1788d604 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926" status: 200 len: 1406 microversion: 2.20 time: 0.229096 Aug 01 16:43:57.492361 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 328/668] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:43:57 2022] GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926 => generated 1406 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:43:57.505882 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-6f9e1973-8251-4aa7-9c83-f66d4545e579 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:57.506333 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-6f9e1973-8251-4aa7-9c83-f66d4545e579 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:57.507109 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-6f9e1973-8251-4aa7-9c83-f66d4545e579 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:57.507711 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-6f9e1973-8251-4aa7-9c83-f66d4545e579 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:57.852807 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-03b2b965-aaab-4398-86a5-422a7329ca35 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:57.853852 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-03b2b965-aaab-4398-86a5-422a7329ca35 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] [instance: 45745fab-4299-4cef-a04a-619855e55336] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:57.860881 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-03b2b965-aaab-4398-86a5-422a7329ca35 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:57.861329 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-03b2b965-aaab-4398-86a5-422a7329ca35 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:57.862100 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-03b2b965-aaab-4398-86a5-422a7329ca35 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:57.862522 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-03b2b965-aaab-4398-86a5-422a7329ca35 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:58.061205 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-6f9e1973-8251-4aa7-9c83-f66d4545e579 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0aed0278344119aae6906f4f52b1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b66d46c3e7d42b88f2dbdc01232fb03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:58.070763 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-6f9e1973-8251-4aa7-9c83-f66d4545e579 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/e2e46d25-15d6-4671-8d04-9994875a9f96" status: 200 len: 1363 microversion: 2.1 time: 0.588135 Aug 01 16:43:58.074101 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 341/669] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:43:57 2022] GET /compute/v2.1/servers/e2e46d25-15d6-4671-8d04-9994875a9f96 => generated 1363 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:43:58.132514 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-03b2b965-aaab-4398-86a5-422a7329ca35 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22cfd17a6f434deca7ef77253ae3ed2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86fcc5e23854dfba97058deac8211d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:58.145260 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-03b2b965-aaab-4398-86a5-422a7329ca35 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] 10.222.0.45 "GET /compute/v2.1/servers/45745fab-4299-4cef-a04a-619855e55336" status: 200 len: 1267 microversion: 2.1 time: 0.296268 Aug 01 16:43:58.147129 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 329/670] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:43:57 2022] GET /compute/v2.1/servers/45745fab-4299-4cef-a04a-619855e55336 => generated 1267 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:43:58.178522 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [req-9b4c9272-b487-441c-bcf5-85399b53f989 req-3d2a974a-2040-4fd3-b749-07d9f31b4efc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2e46d25-15d6-4671-8d04-9994875a9f96", "tag": "d8d32320-e56a-4eb6-ab5a-25467f73451f"}]} {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:43:58.192126 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-9b4c9272-b487-441c-bcf5-85399b53f989 req-3d2a974a-2040-4fd3-b749-07d9f31b4efc service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:58.192953 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-9b4c9272-b487-441c-bcf5-85399b53f989 req-3d2a974a-2040-4fd3-b749-07d9f31b4efc service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:58.205811 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.compute.server_external_events [req-9b4c9272-b487-441c-bcf5-85399b53f989 req-3d2a974a-2040-4fd3-b749-07d9f31b4efc service nova] Creating event network-changed:d8d32320-e56a-4eb6-ab5a-25467f73451f for instance e2e46d25-15d6-4671-8d04-9994875a9f96 on hv-cinder-85032 Aug 01 16:43:58.210726 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [req-9b4c9272-b487-441c-bcf5-85399b53f989 req-3d2a974a-2040-4fd3-b749-07d9f31b4efc service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036086 Aug 01 16:43:58.211358 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 342/671] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:43:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:43:58.312423 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-45997d8b-c5ea-4fec-adee-aac7885b1ff4 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:58.314235 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-45997d8b-c5ea-4fec-adee-aac7885b1ff4 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: 87f86dcf-be4f-4fb9-9957-d2c5c10d999c] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:58.323118 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-45997d8b-c5ea-4fec-adee-aac7885b1ff4 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:58.323564 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-45997d8b-c5ea-4fec-adee-aac7885b1ff4 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:58.325171 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-45997d8b-c5ea-4fec-adee-aac7885b1ff4 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:58.325602 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-45997d8b-c5ea-4fec-adee-aac7885b1ff4 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:58.471788 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-45997d8b-c5ea-4fec-adee-aac7885b1ff4 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:58.480887 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-45997d8b-c5ea-4fec-adee-aac7885b1ff4 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c" status: 200 len: 1731 microversion: 2.1 time: 0.175961 Aug 01 16:43:58.481463 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 330/672] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:43:58 2022] GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c => generated 1731 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:43:58.502191 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-003a4ab6-73e9-424e-80ba-9c0552b8dee1 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:58.502942 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-003a4ab6-73e9-424e-80ba-9c0552b8dee1 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: 87f86dcf-be4f-4fb9-9957-d2c5c10d999c] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:58.509677 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-003a4ab6-73e9-424e-80ba-9c0552b8dee1 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:58.510426 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-003a4ab6-73e9-424e-80ba-9c0552b8dee1 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:58.511398 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-003a4ab6-73e9-424e-80ba-9c0552b8dee1 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:58.512039 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-003a4ab6-73e9-424e-80ba-9c0552b8dee1 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:58.515052 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-bb1263da-44d3-46ee-b678-15db408b2e13 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:58.515660 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-bb1263da-44d3-46ee-b678-15db408b2e13 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:58.522955 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-bb1263da-44d3-46ee-b678-15db408b2e13 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:58.526992 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-bb1263da-44d3-46ee-b678-15db408b2e13 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:58.526992 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-bb1263da-44d3-46ee-b678-15db408b2e13 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:58.526992 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-bb1263da-44d3-46ee-b678-15db408b2e13 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:58.621568 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-003a4ab6-73e9-424e-80ba-9c0552b8dee1 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.123553 Aug 01 16:43:58.622746 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 343/673] 10.222.0.45 () {58 vars in 1275 bytes} [Mon Aug 1 16:43:58 2022] GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c/os-interface => generated 285 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:43:58.696319 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-bb1263da-44d3-46ee-b678-15db408b2e13 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:58.706388 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-bb1263da-44d3-46ee-b678-15db408b2e13 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:58.707913 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-bb1263da-44d3-46ee-b678-15db408b2e13 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:58.709070 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-bb1263da-44d3-46ee-b678-15db408b2e13 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926" status: 200 len: 1406 microversion: 2.20 time: 0.198130 Aug 01 16:43:58.709660 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 331/674] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:43:58 2022] GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926 => generated 1406 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:43:59.093231 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-d512e751-db25-4e71-b434-c1788d4d086d tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:59.093866 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-d512e751-db25-4e71-b434-c1788d4d086d tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: e2e46d25-15d6-4671-8d04-9994875a9f96] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:59.100369 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-d512e751-db25-4e71-b434-c1788d4d086d tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:59.100841 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-d512e751-db25-4e71-b434-c1788d4d086d tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:59.101613 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-d512e751-db25-4e71-b434-c1788d4d086d tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:59.102049 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-d512e751-db25-4e71-b434-c1788d4d086d tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:59.167645 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-f6ddc216-3537-40cb-8750-54e771554cc4 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:59.168440 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-f6ddc216-3537-40cb-8750-54e771554cc4 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] [instance: 45745fab-4299-4cef-a04a-619855e55336] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:59.174903 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-f6ddc216-3537-40cb-8750-54e771554cc4 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:59.175336 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-f6ddc216-3537-40cb-8750-54e771554cc4 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:59.176160 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-f6ddc216-3537-40cb-8750-54e771554cc4 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:59.176589 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-f6ddc216-3537-40cb-8750-54e771554cc4 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:59.182400 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_cell1:SELECT=100 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:43:59.612794 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-d512e751-db25-4e71-b434-c1788d4d086d tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0aed0278344119aae6906f4f52b1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b66d46c3e7d42b88f2dbdc01232fb03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:59.625320 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-d512e751-db25-4e71-b434-c1788d4d086d tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/e2e46d25-15d6-4671-8d04-9994875a9f96" status: 200 len: 1363 microversion: 2.1 time: 0.536352 Aug 01 16:43:59.627250 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 344/675] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:43:59 2022] GET /compute/v2.1/servers/e2e46d25-15d6-4671-8d04-9994875a9f96 => generated 1363 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:43:59.639848 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-f6ddc216-3537-40cb-8750-54e771554cc4 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22cfd17a6f434deca7ef77253ae3ed2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86fcc5e23854dfba97058deac8211d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:43:59.650624 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-f6ddc216-3537-40cb-8750-54e771554cc4 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] 10.222.0.45 "GET /compute/v2.1/servers/45745fab-4299-4cef-a04a-619855e55336" status: 200 len: 1267 microversion: 2.1 time: 0.487789 Aug 01 16:43:59.651500 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 332/676] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:43:59 2022] GET /compute/v2.1/servers/45745fab-4299-4cef-a04a-619855e55336 => generated 1267 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:43:59.732463 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-8c8d9450-86d4-4efc-a02b-7c86c423de51 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:43:59.733490 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-8c8d9450-86d4-4efc-a02b-7c86c423de51 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:43:59.740366 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-8c8d9450-86d4-4efc-a02b-7c86c423de51 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:59.741074 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-8c8d9450-86d4-4efc-a02b-7c86c423de51 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:59.742103 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-8c8d9450-86d4-4efc-a02b-7c86c423de51 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:59.742491 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-8c8d9450-86d4-4efc-a02b-7c86c423de51 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:59.887264 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [req-e430d634-bd98-41e5-bf25-933bc3dc5efd req-aaa1ccca-1c52-4d1a-ac11-d915a2310b23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87f86dcf-be4f-4fb9-9957-d2c5c10d999c", "tag": "6e2de669-4a5d-4e6f-be74-46aa73411e81"}]} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:43:59.899228 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-e430d634-bd98-41e5-bf25-933bc3dc5efd req-aaa1ccca-1c52-4d1a-ac11-d915a2310b23 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:43:59.900024 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-e430d634-bd98-41e5-bf25-933bc3dc5efd req-aaa1ccca-1c52-4d1a-ac11-d915a2310b23 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:43:59.916162 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.compute.server_external_events [req-e430d634-bd98-41e5-bf25-933bc3dc5efd req-aaa1ccca-1c52-4d1a-ac11-d915a2310b23 service nova] Creating event network-changed:6e2de669-4a5d-4e6f-be74-46aa73411e81 for instance 87f86dcf-be4f-4fb9-9957-d2c5c10d999c on hv-cinder-85032 Aug 01 16:43:59.921969 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [req-e430d634-bd98-41e5-bf25-933bc3dc5efd req-aaa1ccca-1c52-4d1a-ac11-d915a2310b23 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040093 Aug 01 16:43:59.923162 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 333/677] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:43:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 16:44:00.085583 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-8c8d9450-86d4-4efc-a02b-7c86c423de51 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:44:00.095777 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-8c8d9450-86d4-4efc-a02b-7c86c423de51 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:44:00.097321 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-8c8d9450-86d4-4efc-a02b-7c86c423de51 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:44:00.098455 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-8c8d9450-86d4-4efc-a02b-7c86c423de51 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926" status: 200 len: 1406 microversion: 2.20 time: 0.370014 Aug 01 16:44:00.099098 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 345/678] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:43:59 2022] GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926 => generated 1406 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:44:00.568785 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [req-021d3aa6-2fe8-43dd-b0ec-1fb0c7bc4ae2 req-5e365bc6-ac6a-424b-b493-08a69d59f9de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45745fab-4299-4cef-a04a-619855e55336", "name": "network-vif-plugged", "status": "completed", "tag": "11c59797-892f-4432-9ed5-d068c34e65d5"}]} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:44:00.584215 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-021d3aa6-2fe8-43dd-b0ec-1fb0c7bc4ae2 req-5e365bc6-ac6a-424b-b493-08a69d59f9de service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:00.584903 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-021d3aa6-2fe8-43dd-b0ec-1fb0c7bc4ae2 req-5e365bc6-ac6a-424b-b493-08a69d59f9de service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:00.603691 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.compute.server_external_events [req-021d3aa6-2fe8-43dd-b0ec-1fb0c7bc4ae2 req-5e365bc6-ac6a-424b-b493-08a69d59f9de service nova] Creating event network-vif-plugged:11c59797-892f-4432-9ed5-d068c34e65d5 for instance 45745fab-4299-4cef-a04a-619855e55336 on hv-cinder-85032 Aug 01 16:44:00.612250 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [req-021d3aa6-2fe8-43dd-b0ec-1fb0c7bc4ae2 req-5e365bc6-ac6a-424b-b493-08a69d59f9de service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048589 Aug 01 16:44:00.613323 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 334/679] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:44:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:44:00.646833 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-2a21f444-14f3-4174-9a41-07a665697bb9 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:44:00.647466 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-2a21f444-14f3-4174-9a41-07a665697bb9 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: e2e46d25-15d6-4671-8d04-9994875a9f96] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:44:00.655032 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_cell0:SELECT=2 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:44:00.656847 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-2a21f444-14f3-4174-9a41-07a665697bb9 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:00.657300 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-2a21f444-14f3-4174-9a41-07a665697bb9 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:00.658206 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-2a21f444-14f3-4174-9a41-07a665697bb9 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:00.658503 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-2a21f444-14f3-4174-9a41-07a665697bb9 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:00.671787 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-b5be933b-3bf3-40ec-b4e2-0b9ddb73af7b tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:44:00.673595 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-b5be933b-3bf3-40ec-b4e2-0b9ddb73af7b tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] [instance: 45745fab-4299-4cef-a04a-619855e55336] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:44:00.681758 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-b5be933b-3bf3-40ec-b4e2-0b9ddb73af7b tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:00.684460 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-b5be933b-3bf3-40ec-b4e2-0b9ddb73af7b tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:00.686767 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-b5be933b-3bf3-40ec-b4e2-0b9ddb73af7b tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:00.687469 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-b5be933b-3bf3-40ec-b4e2-0b9ddb73af7b tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:01.175354 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-2a21f444-14f3-4174-9a41-07a665697bb9 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0aed0278344119aae6906f4f52b1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b66d46c3e7d42b88f2dbdc01232fb03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:44:01.183982 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-2a21f444-14f3-4174-9a41-07a665697bb9 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/e2e46d25-15d6-4671-8d04-9994875a9f96" status: 200 len: 1363 microversion: 2.1 time: 0.540977 Aug 01 16:44:01.184980 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 346/680] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:44:00 2022] GET /compute/v2.1/servers/e2e46d25-15d6-4671-8d04-9994875a9f96 => generated 1363 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:44:01.189582 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-a35601e3-20ed-4282-915e-8ddb1283dde3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:44:01.190173 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-a35601e3-20ed-4282-915e-8ddb1283dde3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:44:01.196509 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a35601e3-20ed-4282-915e-8ddb1283dde3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:01.197344 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a35601e3-20ed-4282-915e-8ddb1283dde3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:01.198140 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a35601e3-20ed-4282-915e-8ddb1283dde3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:01.198572 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a35601e3-20ed-4282-915e-8ddb1283dde3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:01.216894 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-b5be933b-3bf3-40ec-b4e2-0b9ddb73af7b tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22cfd17a6f434deca7ef77253ae3ed2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86fcc5e23854dfba97058deac8211d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:44:01.228819 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-b5be933b-3bf3-40ec-b4e2-0b9ddb73af7b tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] 10.222.0.45 "GET /compute/v2.1/servers/45745fab-4299-4cef-a04a-619855e55336" status: 200 len: 1267 microversion: 2.1 time: 0.561103 Aug 01 16:44:01.229413 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 335/681] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:44:00 2022] GET /compute/v2.1/servers/45745fab-4299-4cef-a04a-619855e55336 => generated 1267 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:44:01.531297 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-a35601e3-20ed-4282-915e-8ddb1283dde3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:44:01.540891 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-a35601e3-20ed-4282-915e-8ddb1283dde3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:44:01.542765 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-a35601e3-20ed-4282-915e-8ddb1283dde3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:44:01.543797 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-a35601e3-20ed-4282-915e-8ddb1283dde3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926" status: 200 len: 1406 microversion: 2.20 time: 0.357852 Aug 01 16:44:01.544712 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 347/682] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:44:01 2022] GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926 => generated 1406 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:44:01.937871 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [req-862fb6a3-efc4-4a3e-bc50-79411144e21b req-c7f2d36e-e53a-4c46-a4f3-53472aa78fee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87f86dcf-be4f-4fb9-9957-d2c5c10d999c", "tag": "6e2de669-4a5d-4e6f-be74-46aa73411e81"}]} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:44:01.948369 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-862fb6a3-efc4-4a3e-bc50-79411144e21b req-c7f2d36e-e53a-4c46-a4f3-53472aa78fee service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:01.948801 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-862fb6a3-efc4-4a3e-bc50-79411144e21b req-c7f2d36e-e53a-4c46-a4f3-53472aa78fee service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:01.964996 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.compute.server_external_events [req-862fb6a3-efc4-4a3e-bc50-79411144e21b req-c7f2d36e-e53a-4c46-a4f3-53472aa78fee service nova] Creating event network-changed:6e2de669-4a5d-4e6f-be74-46aa73411e81 for instance 87f86dcf-be4f-4fb9-9957-d2c5c10d999c on hv-cinder-85032 Aug 01 16:44:01.970431 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [req-862fb6a3-efc4-4a3e-bc50-79411144e21b req-c7f2d36e-e53a-4c46-a4f3-53472aa78fee service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036345 Aug 01 16:44:01.971041 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 336/683] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:44:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:44:02.219501 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-78463cd8-7f1e-43a9-b6b3-fcf5dc17189e tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:44:02.220364 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-78463cd8-7f1e-43a9-b6b3-fcf5dc17189e tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: e2e46d25-15d6-4671-8d04-9994875a9f96] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:44:02.228582 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-78463cd8-7f1e-43a9-b6b3-fcf5dc17189e tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:02.229213 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-78463cd8-7f1e-43a9-b6b3-fcf5dc17189e tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:02.230243 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-78463cd8-7f1e-43a9-b6b3-fcf5dc17189e tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:02.230765 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-78463cd8-7f1e-43a9-b6b3-fcf5dc17189e tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:02.247100 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_cell0:SELECT=2 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:44:02.248406 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_cell0:SELECT=12 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:44:02.253209 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-3c7ea744-72ed-4b69-b481-de29365770a5 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:44:02.254180 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-3c7ea744-72ed-4b69-b481-de29365770a5 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] [instance: 45745fab-4299-4cef-a04a-619855e55336] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:44:02.262734 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-3c7ea744-72ed-4b69-b481-de29365770a5 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:02.263187 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-3c7ea744-72ed-4b69-b481-de29365770a5 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:02.264015 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-3c7ea744-72ed-4b69-b481-de29365770a5 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:02.264642 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-3c7ea744-72ed-4b69-b481-de29365770a5 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:02.377773 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_cell0:SELECT=14 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:44:02.450636 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-78463cd8-7f1e-43a9-b6b3-fcf5dc17189e tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0aed0278344119aae6906f4f52b1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b66d46c3e7d42b88f2dbdc01232fb03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:44:02.452927 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:44:02.459791 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-78463cd8-7f1e-43a9-b6b3-fcf5dc17189e tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/e2e46d25-15d6-4671-8d04-9994875a9f96" status: 200 len: 1363 microversion: 2.1 time: 0.246871 Aug 01 16:44:02.460395 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 348/684] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:44:02 2022] GET /compute/v2.1/servers/e2e46d25-15d6-4671-8d04-9994875a9f96 => generated 1363 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:44:02.466442 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-3c7ea744-72ed-4b69-b481-de29365770a5 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22cfd17a6f434deca7ef77253ae3ed2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86fcc5e23854dfba97058deac8211d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:44:02.476907 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-3c7ea744-72ed-4b69-b481-de29365770a5 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] 10.222.0.45 "GET /compute/v2.1/servers/45745fab-4299-4cef-a04a-619855e55336" status: 200 len: 1454 microversion: 2.1 time: 0.230660 Aug 01 16:44:02.478627 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 337/685] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:44:02 2022] GET /compute/v2.1/servers/45745fab-4299-4cef-a04a-619855e55336 => generated 1454 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:44:02.498009 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-7d1ce3e9-3aff-466a-8ce5-116cd61bfa62 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:44:02.498657 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-7d1ce3e9-3aff-466a-8ce5-116cd61bfa62 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] [instance: 45745fab-4299-4cef-a04a-619855e55336] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:44:02.505720 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-7d1ce3e9-3aff-466a-8ce5-116cd61bfa62 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:02.506156 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-7d1ce3e9-3aff-466a-8ce5-116cd61bfa62 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:02.506902 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-7d1ce3e9-3aff-466a-8ce5-116cd61bfa62 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:02.507316 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-7d1ce3e9-3aff-466a-8ce5-116cd61bfa62 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:02.567294 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-514656cb-0461-494a-9770-f9b74987ffe6 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:44:02.568029 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-514656cb-0461-494a-9770-f9b74987ffe6 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:44:02.575393 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-514656cb-0461-494a-9770-f9b74987ffe6 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:02.575867 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-514656cb-0461-494a-9770-f9b74987ffe6 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:02.576918 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-514656cb-0461-494a-9770-f9b74987ffe6 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:02.577282 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-514656cb-0461-494a-9770-f9b74987ffe6 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:02.797209 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-7d1ce3e9-3aff-466a-8ce5-116cd61bfa62 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22cfd17a6f434deca7ef77253ae3ed2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86fcc5e23854dfba97058deac8211d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:44:02.805334 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-7d1ce3e9-3aff-466a-8ce5-116cd61bfa62 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] 10.222.0.45 "GET /compute/v2.1/servers/45745fab-4299-4cef-a04a-619855e55336" status: 200 len: 1454 microversion: 2.1 time: 0.311474 Aug 01 16:44:02.805908 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 349/686] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:44:02 2022] GET /compute/v2.1/servers/45745fab-4299-4cef-a04a-619855e55336 => generated 1454 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:44:02.819606 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-514656cb-0461-494a-9770-f9b74987ffe6 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:44:02.828864 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-514656cb-0461-494a-9770-f9b74987ffe6 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:44:02.830357 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-514656cb-0461-494a-9770-f9b74987ffe6 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:44:02.831474 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-514656cb-0461-494a-9770-f9b74987ffe6 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926" status: 200 len: 1406 microversion: 2.20 time: 0.268523 Aug 01 16:44:02.832046 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 338/687] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:44:02 2022] GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926 => generated 1406 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 16:44:03.483563 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-3c47013f-e98d-4b19-a3bf-b548be1e032e tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:44:03.484196 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-3c47013f-e98d-4b19-a3bf-b548be1e032e tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: e2e46d25-15d6-4671-8d04-9994875a9f96] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:44:03.490626 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3c47013f-e98d-4b19-a3bf-b548be1e032e tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:03.491069 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3c47013f-e98d-4b19-a3bf-b548be1e032e tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:03.491883 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3c47013f-e98d-4b19-a3bf-b548be1e032e tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:03.492313 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3c47013f-e98d-4b19-a3bf-b548be1e032e tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:03.643312 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-3c47013f-e98d-4b19-a3bf-b548be1e032e tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0aed0278344119aae6906f4f52b1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b66d46c3e7d42b88f2dbdc01232fb03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:44:03.652891 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-3c47013f-e98d-4b19-a3bf-b548be1e032e tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/e2e46d25-15d6-4671-8d04-9994875a9f96" status: 200 len: 1363 microversion: 2.1 time: 0.173137 Aug 01 16:44:03.663968 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 350/688] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:44:03 2022] GET /compute/v2.1/servers/e2e46d25-15d6-4671-8d04-9994875a9f96 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:44:03.855078 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-c2a498e9-00e8-4a65-a494-6b35bbce8dcc tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:44:03.855649 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-c2a498e9-00e8-4a65-a494-6b35bbce8dcc tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:44:03.862875 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-c2a498e9-00e8-4a65-a494-6b35bbce8dcc tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:03.863324 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-c2a498e9-00e8-4a65-a494-6b35bbce8dcc tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:03.864136 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-c2a498e9-00e8-4a65-a494-6b35bbce8dcc tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:03.864571 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-c2a498e9-00e8-4a65-a494-6b35bbce8dcc tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:04.008305 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-c2a498e9-00e8-4a65-a494-6b35bbce8dcc tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:44:04.017552 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-c2a498e9-00e8-4a65-a494-6b35bbce8dcc tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:44:04.019215 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-c2a498e9-00e8-4a65-a494-6b35bbce8dcc tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:44:04.020417 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-c2a498e9-00e8-4a65-a494-6b35bbce8dcc tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926" status: 200 len: 1406 microversion: 2.20 time: 0.169577 Aug 01 16:44:04.021412 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 339/689] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:44:03 2022] GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926 => generated 1406 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:44:04.396626 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [req-dac84570-885b-4a84-987f-ad0e311b0d21 req-8fa8c874-48af-4433-89ba-57143a0c8040 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "144c8e15-97cd-4e0d-9d60-2ba97c26e926", "name": "network-vif-plugged", "status": "completed", "tag": "4f59fd5b-8ef2-4634-a3a5-063fd9fa3526"}]} {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:44:04.406874 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-dac84570-885b-4a84-987f-ad0e311b0d21 req-8fa8c874-48af-4433-89ba-57143a0c8040 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:04.407649 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-dac84570-885b-4a84-987f-ad0e311b0d21 req-8fa8c874-48af-4433-89ba-57143a0c8040 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:04.421044 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.compute.server_external_events [req-dac84570-885b-4a84-987f-ad0e311b0d21 req-8fa8c874-48af-4433-89ba-57143a0c8040 service nova] Creating event network-vif-plugged:4f59fd5b-8ef2-4634-a3a5-063fd9fa3526 for instance 144c8e15-97cd-4e0d-9d60-2ba97c26e926 on hv-cinder-85032 Aug 01 16:44:04.426821 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [req-dac84570-885b-4a84-987f-ad0e311b0d21 req-8fa8c874-48af-4433-89ba-57143a0c8040 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033784 Aug 01 16:44:04.427583 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 351/690] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:44:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:44:04.675204 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-af3578e1-a23a-484d-9e0f-42c2e8c5afa0 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:44:04.675876 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-af3578e1-a23a-484d-9e0f-42c2e8c5afa0 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: e2e46d25-15d6-4671-8d04-9994875a9f96] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:44:04.678827 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:44:04.683560 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-af3578e1-a23a-484d-9e0f-42c2e8c5afa0 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:04.684040 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-af3578e1-a23a-484d-9e0f-42c2e8c5afa0 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:04.684865 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-af3578e1-a23a-484d-9e0f-42c2e8c5afa0 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:04.685291 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-af3578e1-a23a-484d-9e0f-42c2e8c5afa0 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:04.830929 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-af3578e1-a23a-484d-9e0f-42c2e8c5afa0 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0aed0278344119aae6906f4f52b1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b66d46c3e7d42b88f2dbdc01232fb03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:44:04.845481 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-af3578e1-a23a-484d-9e0f-42c2e8c5afa0 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/e2e46d25-15d6-4671-8d04-9994875a9f96" status: 200 len: 1363 microversion: 2.1 time: 0.174130 Aug 01 16:44:04.854611 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 340/691] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:44:04 2022] GET /compute/v2.1/servers/e2e46d25-15d6-4671-8d04-9994875a9f96 => generated 1363 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:44:05.044602 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-640d7a97-9267-4cb7-8750-ada4904dbfe2 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:44:05.045269 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-640d7a97-9267-4cb7-8750-ada4904dbfe2 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:44:05.052223 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-640d7a97-9267-4cb7-8750-ada4904dbfe2 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:05.052667 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-640d7a97-9267-4cb7-8750-ada4904dbfe2 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:05.053418 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-640d7a97-9267-4cb7-8750-ada4904dbfe2 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:05.053838 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-640d7a97-9267-4cb7-8750-ada4904dbfe2 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:05.207611 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-640d7a97-9267-4cb7-8750-ada4904dbfe2 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:44:05.216890 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-640d7a97-9267-4cb7-8750-ada4904dbfe2 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:44:05.218777 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-640d7a97-9267-4cb7-8750-ada4904dbfe2 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:44:05.219936 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-640d7a97-9267-4cb7-8750-ada4904dbfe2 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926" status: 200 len: 1406 microversion: 2.20 time: 0.180747 Aug 01 16:44:05.220495 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 352/692] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:44:05 2022] GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926 => generated 1406 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:44:05.233304 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [req-90b55999-d960-4372-a7bd-4e7618a3de2d req-c9903344-73c3-4181-8ad4-033de3432a1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45745fab-4299-4cef-a04a-619855e55336", "tag": "11c59797-892f-4432-9ed5-d068c34e65d5"}]} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:44:05.243250 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-90b55999-d960-4372-a7bd-4e7618a3de2d req-c9903344-73c3-4181-8ad4-033de3432a1f service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:05.243912 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-90b55999-d960-4372-a7bd-4e7618a3de2d req-c9903344-73c3-4181-8ad4-033de3432a1f service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:05.255317 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.compute.server_external_events [req-90b55999-d960-4372-a7bd-4e7618a3de2d req-c9903344-73c3-4181-8ad4-033de3432a1f service nova] Creating event network-changed:11c59797-892f-4432-9ed5-d068c34e65d5 for instance 45745fab-4299-4cef-a04a-619855e55336 on hv-cinder-85032 Aug 01 16:44:05.260205 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [req-90b55999-d960-4372-a7bd-4e7618a3de2d req-c9903344-73c3-4181-8ad4-033de3432a1f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031316 Aug 01 16:44:05.260799 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 341/693] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:44:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:44:05.877864 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-dd665600-edb6-4b59-99cf-65d56ff2c9c5 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:44:05.878355 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-dd665600-edb6-4b59-99cf-65d56ff2c9c5 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: e2e46d25-15d6-4671-8d04-9994875a9f96] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:44:05.885080 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-dd665600-edb6-4b59-99cf-65d56ff2c9c5 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:05.885757 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-dd665600-edb6-4b59-99cf-65d56ff2c9c5 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:05.886731 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-dd665600-edb6-4b59-99cf-65d56ff2c9c5 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:05.887153 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-dd665600-edb6-4b59-99cf-65d56ff2c9c5 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:06.033198 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-dd665600-edb6-4b59-99cf-65d56ff2c9c5 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0aed0278344119aae6906f4f52b1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b66d46c3e7d42b88f2dbdc01232fb03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:44:06.041870 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-dd665600-edb6-4b59-99cf-65d56ff2c9c5 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/e2e46d25-15d6-4671-8d04-9994875a9f96" status: 200 len: 1363 microversion: 2.1 time: 0.167967 Aug 01 16:44:06.042445 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 353/694] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:44:05 2022] GET /compute/v2.1/servers/e2e46d25-15d6-4671-8d04-9994875a9f96 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:44:06.245162 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-7298b45f-8eb5-485a-9112-0d20a12f185a tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:44:06.246508 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-7298b45f-8eb5-485a-9112-0d20a12f185a tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:44:06.254255 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-7298b45f-8eb5-485a-9112-0d20a12f185a tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:06.254992 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-7298b45f-8eb5-485a-9112-0d20a12f185a tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:06.255754 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-7298b45f-8eb5-485a-9112-0d20a12f185a tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:06.256207 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-7298b45f-8eb5-485a-9112-0d20a12f185a tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:06.438108 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-7298b45f-8eb5-485a-9112-0d20a12f185a tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:44:06.449106 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-7298b45f-8eb5-485a-9112-0d20a12f185a tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:44:06.450708 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-7298b45f-8eb5-485a-9112-0d20a12f185a tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:44:06.452506 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-7298b45f-8eb5-485a-9112-0d20a12f185a tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926" status: 200 len: 1406 microversion: 2.20 time: 0.213362 Aug 01 16:44:06.453033 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 342/695] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:44:06 2022] GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926 => generated 1406 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:44:06.480425 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [req-5b453a0d-6840-4ab5-82c2-5aba0c562927 req-2b4ecadd-7659-41b1-8a78-9548e20bd6e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2e46d25-15d6-4671-8d04-9994875a9f96", "name": "network-vif-plugged", "status": "completed", "tag": "d8d32320-e56a-4eb6-ab5a-25467f73451f"}]} {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:44:06.497091 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-5b453a0d-6840-4ab5-82c2-5aba0c562927 req-2b4ecadd-7659-41b1-8a78-9548e20bd6e9 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:06.497561 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-5b453a0d-6840-4ab5-82c2-5aba0c562927 req-2b4ecadd-7659-41b1-8a78-9548e20bd6e9 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:06.516182 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.compute.server_external_events [req-5b453a0d-6840-4ab5-82c2-5aba0c562927 req-2b4ecadd-7659-41b1-8a78-9548e20bd6e9 service nova] Creating event network-vif-plugged:d8d32320-e56a-4eb6-ab5a-25467f73451f for instance e2e46d25-15d6-4671-8d04-9994875a9f96 on hv-cinder-85032 Aug 01 16:44:06.522522 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [req-5b453a0d-6840-4ab5-82c2-5aba0c562927 req-2b4ecadd-7659-41b1-8a78-9548e20bd6e9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056126 Aug 01 16:44:06.523719 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 354/696] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:44:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:44:07.064346 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-cf868cc6-d619-45e9-9f68-7cd8a20ee128 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:44:07.065595 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-cf868cc6-d619-45e9-9f68-7cd8a20ee128 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: e2e46d25-15d6-4671-8d04-9994875a9f96] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:44:07.072048 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-cf868cc6-d619-45e9-9f68-7cd8a20ee128 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:07.072676 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-cf868cc6-d619-45e9-9f68-7cd8a20ee128 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:07.073447 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-cf868cc6-d619-45e9-9f68-7cd8a20ee128 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:07.073875 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-cf868cc6-d619-45e9-9f68-7cd8a20ee128 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:07.216906 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-cf868cc6-d619-45e9-9f68-7cd8a20ee128 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0aed0278344119aae6906f4f52b1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b66d46c3e7d42b88f2dbdc01232fb03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:44:07.225766 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-cf868cc6-d619-45e9-9f68-7cd8a20ee128 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/e2e46d25-15d6-4671-8d04-9994875a9f96" status: 200 len: 1363 microversion: 2.1 time: 0.166332 Aug 01 16:44:07.226373 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 343/697] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:44:07 2022] GET /compute/v2.1/servers/e2e46d25-15d6-4671-8d04-9994875a9f96 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:44:07.478816 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-73f0ae04-d740-48de-87ee-aaf68c4149bc tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:44:07.479421 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-73f0ae04-d740-48de-87ee-aaf68c4149bc tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:44:07.486408 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-73f0ae04-d740-48de-87ee-aaf68c4149bc tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:07.487148 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-73f0ae04-d740-48de-87ee-aaf68c4149bc tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:07.487606 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-73f0ae04-d740-48de-87ee-aaf68c4149bc tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:07.488084 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-73f0ae04-d740-48de-87ee-aaf68c4149bc tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:07.634543 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-73f0ae04-d740-48de-87ee-aaf68c4149bc tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:44:07.643158 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-73f0ae04-d740-48de-87ee-aaf68c4149bc tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:44:07.645045 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-73f0ae04-d740-48de-87ee-aaf68c4149bc tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:44:07.646748 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-73f0ae04-d740-48de-87ee-aaf68c4149bc tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926" status: 200 len: 1599 microversion: 2.20 time: 0.173231 Aug 01 16:44:07.647786 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 355/698] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:44:07 2022] GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926 => generated 1599 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:44:07.673452 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-7b65c47e-5feb-41da-a404-a51707d3d7df tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:44:07.675424 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-7b65c47e-5feb-41da-a404-a51707d3d7df tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:44:07.681031 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-7b65c47e-5feb-41da-a404-a51707d3d7df tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:07.681467 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-7b65c47e-5feb-41da-a404-a51707d3d7df tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:07.682254 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-7b65c47e-5feb-41da-a404-a51707d3d7df tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:07.682684 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-7b65c47e-5feb-41da-a404-a51707d3d7df tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:07.762620 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-7b65c47e-5feb-41da-a404-a51707d3d7df tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.093014 Aug 01 16:44:07.763337 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 344/699] 10.222.0.45 () {60 vars in 1316 bytes} [Mon Aug 1 16:44:07 2022] GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 16:44:08.250187 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-c8469612-2bfd-4cbd-864d-f9041601acdc tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:44:08.250943 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-c8469612-2bfd-4cbd-864d-f9041601acdc tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: e2e46d25-15d6-4671-8d04-9994875a9f96] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:44:08.258026 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-c8469612-2bfd-4cbd-864d-f9041601acdc tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:08.258463 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-c8469612-2bfd-4cbd-864d-f9041601acdc tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:08.259371 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-c8469612-2bfd-4cbd-864d-f9041601acdc tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:08.260129 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-c8469612-2bfd-4cbd-864d-f9041601acdc tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:08.420066 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-c8469612-2bfd-4cbd-864d-f9041601acdc tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0aed0278344119aae6906f4f52b1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b66d46c3e7d42b88f2dbdc01232fb03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:44:08.428226 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-c8469612-2bfd-4cbd-864d-f9041601acdc tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/e2e46d25-15d6-4671-8d04-9994875a9f96" status: 200 len: 1363 microversion: 2.1 time: 0.183569 Aug 01 16:44:08.428830 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 356/700] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:44:08 2022] GET /compute/v2.1/servers/e2e46d25-15d6-4671-8d04-9994875a9f96 => generated 1363 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:44:08.777732 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [req-87bc983a-18fb-41da-a765-0c088e5f6244 req-c3c820f0-1fb7-41c4-b640-f95cc5af5fe0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "144c8e15-97cd-4e0d-9d60-2ba97c26e926", "tag": "4f59fd5b-8ef2-4634-a3a5-063fd9fa3526"}]} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:44:08.787309 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-87bc983a-18fb-41da-a765-0c088e5f6244 req-c3c820f0-1fb7-41c4-b640-f95cc5af5fe0 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:08.787738 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-87bc983a-18fb-41da-a765-0c088e5f6244 req-c3c820f0-1fb7-41c4-b640-f95cc5af5fe0 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:08.799156 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.compute.server_external_events [req-87bc983a-18fb-41da-a765-0c088e5f6244 req-c3c820f0-1fb7-41c4-b640-f95cc5af5fe0 service nova] Creating event network-changed:4f59fd5b-8ef2-4634-a3a5-063fd9fa3526 for instance 144c8e15-97cd-4e0d-9d60-2ba97c26e926 on hv-cinder-85032 Aug 01 16:44:08.804163 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [req-87bc983a-18fb-41da-a765-0c088e5f6244 req-c3c820f0-1fb7-41c4-b640-f95cc5af5fe0 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030620 Aug 01 16:44:08.804945 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 345/701] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:44:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 16:44:09.455029 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-de75d06d-46dd-4490-b411-80ef32451aba tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:44:09.456069 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-de75d06d-46dd-4490-b411-80ef32451aba tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: e2e46d25-15d6-4671-8d04-9994875a9f96] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:44:09.467730 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-de75d06d-46dd-4490-b411-80ef32451aba tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:09.468890 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-de75d06d-46dd-4490-b411-80ef32451aba tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:09.470359 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-de75d06d-46dd-4490-b411-80ef32451aba tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:09.471357 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-de75d06d-46dd-4490-b411-80ef32451aba tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:09.621953 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-de75d06d-46dd-4490-b411-80ef32451aba tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0aed0278344119aae6906f4f52b1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b66d46c3e7d42b88f2dbdc01232fb03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:44:09.633819 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-de75d06d-46dd-4490-b411-80ef32451aba tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/e2e46d25-15d6-4671-8d04-9994875a9f96" status: 200 len: 1549 microversion: 2.1 time: 0.186006 Aug 01 16:44:09.634883 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 357/702] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:44:09 2022] GET /compute/v2.1/servers/e2e46d25-15d6-4671-8d04-9994875a9f96 => generated 1549 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:44:09.655977 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-0f41da0a-cdd6-4d80-802e-3231600ad9e1 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:44:09.656573 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-0f41da0a-cdd6-4d80-802e-3231600ad9e1 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: e2e46d25-15d6-4671-8d04-9994875a9f96] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:44:09.663456 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-0f41da0a-cdd6-4d80-802e-3231600ad9e1 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:09.663929 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-0f41da0a-cdd6-4d80-802e-3231600ad9e1 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:09.664714 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-0f41da0a-cdd6-4d80-802e-3231600ad9e1 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:09.665211 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-0f41da0a-cdd6-4d80-802e-3231600ad9e1 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:09.753183 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-0f41da0a-cdd6-4d80-802e-3231600ad9e1 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/e2e46d25-15d6-4671-8d04-9994875a9f96/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.101556 Aug 01 16:44:09.753893 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 346/703] 10.222.0.45 () {58 vars in 1275 bytes} [Mon Aug 1 16:44:09 2022] GET /compute/v2.1/servers/e2e46d25-15d6-4671-8d04-9994875a9f96/os-interface => generated 285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:44:10.819102 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [req-6c0bbb90-5b6f-4c7d-9f05-d00aa53ada68 req-695cbde6-76e3-4df1-acf9-c4669fff8fb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2e46d25-15d6-4671-8d04-9994875a9f96", "tag": "d8d32320-e56a-4eb6-ab5a-25467f73451f"}]} {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:44:10.829484 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-6c0bbb90-5b6f-4c7d-9f05-d00aa53ada68 req-695cbde6-76e3-4df1-acf9-c4669fff8fb8 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:10.829957 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-6c0bbb90-5b6f-4c7d-9f05-d00aa53ada68 req-695cbde6-76e3-4df1-acf9-c4669fff8fb8 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:10.843270 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.compute.server_external_events [req-6c0bbb90-5b6f-4c7d-9f05-d00aa53ada68 req-695cbde6-76e3-4df1-acf9-c4669fff8fb8 service nova] Creating event network-changed:d8d32320-e56a-4eb6-ab5a-25467f73451f for instance e2e46d25-15d6-4671-8d04-9994875a9f96 on hv-cinder-85032 Aug 01 16:44:10.849127 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [req-6c0bbb90-5b6f-4c7d-9f05-d00aa53ada68 req-695cbde6-76e3-4df1-acf9-c4669fff8fb8 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033052 Aug 01 16:44:10.849311 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 358/704] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:44:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:44:16.019629 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-d0f82c24-a1c6-44f4-9e2d-b4da2eab8a3b tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:44:16.021861 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-d0f82c24-a1c6-44f4-9e2d-b4da2eab8a3b tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 8ad215fb-dc14-4768-98d9-c57389e0d317] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:44:16.029084 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-d0f82c24-a1c6-44f4-9e2d-b4da2eab8a3b tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:16.029532 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-d0f82c24-a1c6-44f4-9e2d-b4da2eab8a3b tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:16.030431 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-d0f82c24-a1c6-44f4-9e2d-b4da2eab8a3b tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:16.030860 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-d0f82c24-a1c6-44f4-9e2d-b4da2eab8a3b tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:16.066339 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-d0f82c24-a1c6-44f4-9e2d-b4da2eab8a3b tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/8ad215fb-dc14-4768-98d9-c57389e0d317/ips" status: 200 len: 149 microversion: 2.1 time: 0.052153 Aug 01 16:44:16.066918 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 347/705] 10.222.0.45 () {58 vars in 1248 bytes} [Mon Aug 1 16:44:16 2022] GET /compute/v2.1/servers/8ad215fb-dc14-4768-98d9-c57389e0d317/ips => generated 149 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:44:17.460272 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-9d0ce299-3ebb-443c-9fff-a4625b87c8d5 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "584721fe-dbe0-46f6-a94d-0b479999bafa"}} {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:44:17.462824 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-9d0ce299-3ebb-443c-9fff-a4625b87c8d5 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 8ad215fb-dc14-4768-98d9-c57389e0d317] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:44:17.469889 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-9d0ce299-3ebb-443c-9fff-a4625b87c8d5 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:17.470314 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-9d0ce299-3ebb-443c-9fff-a4625b87c8d5 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:17.471102 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-9d0ce299-3ebb-443c-9fff-a4625b87c8d5 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:17.471520 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-9d0ce299-3ebb-443c-9fff-a4625b87c8d5 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:17.747958 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-9d0ce299-3ebb-443c-9fff-a4625b87c8d5 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "POST /compute/v2.1/servers/8ad215fb-dc14-4768-98d9-c57389e0d317/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.292080 Aug 01 16:44:17.748571 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 359/706] 10.222.0.45 () {60 vars in 1323 bytes} [Mon Aug 1 16:44:17 2022] POST /compute/v2.1/servers/8ad215fb-dc14-4768-98d9-c57389e0d317/os-volume_attachments => generated 194 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:44:25.378068 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-97b55176-7306-4f14-acb0-a4b16f0d1458 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "584721fe-dbe0-46f6-a94d-0b479999bafa"}} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:44:25.380441 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-97b55176-7306-4f14-acb0-a4b16f0d1458 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 8ad215fb-dc14-4768-98d9-c57389e0d317] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:44:25.387827 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-97b55176-7306-4f14-acb0-a4b16f0d1458 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:25.388270 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-97b55176-7306-4f14-acb0-a4b16f0d1458 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:25.389036 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-97b55176-7306-4f14-acb0-a4b16f0d1458 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:25.389463 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-97b55176-7306-4f14-acb0-a4b16f0d1458 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:25.484267 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.wsgi [None req-97b55176-7306-4f14-acb0-a4b16f0d1458 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] HTTP exception thrown: Invalid volume: volume 584721fe-dbe0-46f6-a94d-0b479999bafa is already attached to instances: 8ad215fb-dc14-4768-98d9-c57389e0d317 Aug 01 16:44:25.487362 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-97b55176-7306-4f14-acb0-a4b16f0d1458 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Request method failure captured: Aug 01 16:44:25.487362 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: request: POST /compute/v2.1/servers/8ad215fb-dc14-4768-98d9-c57389e0d317/os-volume_attachments HTTP/1.1 Aug 01 16:44:25.487362 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Accept: application/json Aug 01 16:44:25.487362 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Accept-Encoding: identity Aug 01 16:44:25.487362 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Connection: close Aug 01 16:44:25.487362 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Content-Length: 74 Aug 01 16:44:25.487362 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Content-Type: application/json Aug 01 16:44:25.487362 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Host: 10.222.0.45 Aug 01 16:44:25.487362 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Openstack-System-Scope: None Aug 01 16:44:25.487362 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: User-Agent: python-urllib3/1.26.10 Aug 01 16:44:25.487362 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Auth-Token: gAAAAABi6AHCRDGoebg0LS7gmy1eTpjTuQd112Y1pcMjujKk6txGUWSA3OMMaHc1baNi_AdoDEvdhzRnASCOKOmNH90_reDUi0PqBGMG7mNlkYUDBNxMpR2mUAgvvel08FXbCsasfVUCgx1es__sgSc1ixE0JQKf1ZzhFBiBb0upY90FvmppuN0 Aug 01 16:44:25.487362 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Domain-Id: None Aug 01 16:44:25.487362 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Domain-Name: None Aug 01 16:44:25.487362 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Identity-Status: Confirmed Aug 01 16:44:25.487362 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Is-Admin-Project: True Aug 01 16:44:25.487362 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Domain-Id: default Aug 01 16:44:25.487362 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Domain-Name: Default Aug 01 16:44:25.487362 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Id: 2f46e472f8614c5e847ceb225cc9bff1 Aug 01 16:44:25.487362 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Name: tempest-AttachVolumeNegativeTest-597514302 Aug 01 16:44:25.487362 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Role: reader,member Aug 01 16:44:25.487362 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Roles: reader,member Aug 01 16:44:25.489064 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2f46e472f8614c5e847ceb225cc9bff1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2f46e472f8614c5e847ceb225cc9bff1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2f46e472f8614c5e847ceb225cc9bff1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2f46e472f8614c5e847ceb225cc9bff1"}]}] Aug 01 16:44:25.489064 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Tenant: tempest-AttachVolumeNegativeTest-597514302 Aug 01 16:44:25.489064 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Tenant-Id: 2f46e472f8614c5e847ceb225cc9bff1 Aug 01 16:44:25.489064 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-597514302 Aug 01 16:44:25.489064 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User: tempest-AttachVolumeNegativeTest-597514302-project Aug 01 16:44:25.489064 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Domain-Id: default Aug 01 16:44:25.489064 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Domain-Name: Default Aug 01 16:44:25.489064 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Id: 1ac7d3acf1204a9f98f9ee14c2b46a5e Aug 01 16:44:25.489064 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Name: tempest-AttachVolumeNegativeTest-597514302-project Aug 01 16:44:25.489064 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Aug 01 16:44:25.489064 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: {"volumeAttachment": {"volumeId": "584721fe-dbe0-46f6-a94d-0b479999bafa"}} Aug 01 16:44:25.489064 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: method: > Aug 01 16:44:25.490410 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: exception: Invalid volume: volume 584721fe-dbe0-46f6-a94d-0b479999bafa is already attached to instances: 8ad215fb-dc14-4768-98d9-c57389e0d317 Aug 01 16:44:25.490410 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: action_args: {'server_id': '8ad215fb-dc14-4768-98d9-c57389e0d317', 'body': {'volumeAttachment': {'volumeId': '584721fe-dbe0-46f6-a94d-0b479999bafa'}}} Aug 01 16:44:25.490410 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:44:25.490410 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:44:25.490410 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 01 16:44:25.490410 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 01 16:44:25.490410 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 01 16:44:25.490410 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 01 16:44:25.490410 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 01 16:44:25.490410 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 01 16:44:25.490410 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 01 16:44:25.490410 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 01 16:44:25.490410 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 01 16:44:25.490410 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 01 16:44:25.490410 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 584721fe-dbe0-46f6-a94d-0b479999bafa is already attached to instances: 8ad215fb-dc14-4768-98d9-c57389e0d317 Aug 01 16:44:25.490410 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:44:25.490410 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:44:25.490410 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:44:25.490410 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:44:25.491559 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:44:25.491559 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:44:25.491559 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:44:25.491559 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:44:25.491559 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:44:25.491559 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:44:25.491559 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 16:44:25.491559 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 16:44:25.491559 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 16:44:25.491559 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 16:44:25.491559 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 16:44:25.491559 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 16:44:25.491559 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 01 16:44:25.491559 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 01 16:44:25.491559 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 584721fe-dbe0-46f6-a94d-0b479999bafa is already attached to instances: 8ad215fb-dc14-4768-98d9-c57389e0d317 Aug 01 16:44:25.491559 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:44:25.491559 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:44:25.491559 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:44:25.491559 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:44:25.491559 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:44:25.493375 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:44:25.493375 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:44:25.493375 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:44:25.493375 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 584721fe-dbe0-46f6-a94d-0b479999bafa is already attached to instances: 8ad215fb-dc14-4768-98d9-c57389e0d317 Aug 01 16:44:25.493375 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:44:25.493375 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-97b55176-7306-4f14-acb0-a4b16f0d1458 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Returning 400 to user: Invalid volume: volume 584721fe-dbe0-46f6-a94d-0b479999bafa is already attached to instances: 8ad215fb-dc14-4768-98d9-c57389e0d317 {{(pid=118117) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:44:25.493375 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-97b55176-7306-4f14-acb0-a4b16f0d1458 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "POST /compute/v2.1/servers/8ad215fb-dc14-4768-98d9-c57389e0d317/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.115682 Aug 01 16:44:25.493375 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 348/707] 10.222.0.45 () {60 vars in 1323 bytes} [Mon Aug 1 16:44:25 2022] POST /compute/v2.1/servers/8ad215fb-dc14-4768-98d9-c57389e0d317/os-volume_attachments => generated 174 bytes in 118 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 01 16:44:25.567391 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-512ab362-6678-41a4-a8f9-6e1c58dd2a1c tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:44:25.567967 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-512ab362-6678-41a4-a8f9-6e1c58dd2a1c tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 8ad215fb-dc14-4768-98d9-c57389e0d317] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:44:25.569994 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_api:SELECT=66 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:44:25.576316 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-512ab362-6678-41a4-a8f9-6e1c58dd2a1c tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:25.576802 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-512ab362-6678-41a4-a8f9-6e1c58dd2a1c tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:25.577561 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-512ab362-6678-41a4-a8f9-6e1c58dd2a1c tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:25.577965 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-512ab362-6678-41a4-a8f9-6e1c58dd2a1c tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:25.666155 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.objects.instance [None req-512ab362-6678-41a4-a8f9-6e1c58dd2a1c tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lazy-loading 'services' on Instance uuid 8ad215fb-dc14-4768-98d9-c57389e0d317 {{(pid=118118) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 16:44:25.754620 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-512ab362-6678-41a4-a8f9-6e1c58dd2a1c tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "DELETE /compute/v2.1/servers/8ad215fb-dc14-4768-98d9-c57389e0d317/os-volume_attachments/584721fe-dbe0-46f6-a94d-0b479999bafa" status: 202 len: 0 microversion: 2.1 time: 0.191994 Aug 01 16:44:25.755417 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 360/708] 10.222.0.45 () {58 vars in 1416 bytes} [Mon Aug 1 16:44:25 2022] DELETE /compute/v2.1/servers/8ad215fb-dc14-4768-98d9-c57389e0d317/os-volume_attachments/584721fe-dbe0-46f6-a94d-0b479999bafa => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 16:44:25.765170 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-e8cbeee2-c4a0-4a50-8129-76fe8667cb49 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:44:25.767792 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-e8cbeee2-c4a0-4a50-8129-76fe8667cb49 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 8ad215fb-dc14-4768-98d9-c57389e0d317] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:44:25.777330 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-e8cbeee2-c4a0-4a50-8129-76fe8667cb49 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:25.777930 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-e8cbeee2-c4a0-4a50-8129-76fe8667cb49 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:25.779057 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-e8cbeee2-c4a0-4a50-8129-76fe8667cb49 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:25.779648 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-e8cbeee2-c4a0-4a50-8129-76fe8667cb49 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:25.818398 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-e8cbeee2-c4a0-4a50-8129-76fe8667cb49 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/8ad215fb-dc14-4768-98d9-c57389e0d317/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057608 Aug 01 16:44:25.818993 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 349/709] 10.222.0.45 () {58 vars in 1302 bytes} [Mon Aug 1 16:44:25 2022] GET /compute/v2.1/servers/8ad215fb-dc14-4768-98d9-c57389e0d317/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:44:26.834060 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-ac16eefb-d337-44b4-8a53-8a7d821c7c73 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:44:26.837004 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-ac16eefb-d337-44b4-8a53-8a7d821c7c73 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 8ad215fb-dc14-4768-98d9-c57389e0d317] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:44:26.844409 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-ac16eefb-d337-44b4-8a53-8a7d821c7c73 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:26.844880 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-ac16eefb-d337-44b4-8a53-8a7d821c7c73 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:26.845671 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-ac16eefb-d337-44b4-8a53-8a7d821c7c73 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:26.846124 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-ac16eefb-d337-44b4-8a53-8a7d821c7c73 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:26.882036 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-ac16eefb-d337-44b4-8a53-8a7d821c7c73 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/8ad215fb-dc14-4768-98d9-c57389e0d317/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052849 Aug 01 16:44:26.883052 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 361/710] 10.222.0.45 () {58 vars in 1302 bytes} [Mon Aug 1 16:44:26 2022] GET /compute/v2.1/servers/8ad215fb-dc14-4768-98d9-c57389e0d317/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 16:44:26.952582 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-904671f1-799d-450a-9e30-d837f97d79c8 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:44:26.953347 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-904671f1-799d-450a-9e30-d837f97d79c8 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 8ad215fb-dc14-4768-98d9-c57389e0d317] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:44:26.959506 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-904671f1-799d-450a-9e30-d837f97d79c8 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:26.959981 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-904671f1-799d-450a-9e30-d837f97d79c8 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:26.960759 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-904671f1-799d-450a-9e30-d837f97d79c8 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:26.961192 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-904671f1-799d-450a-9e30-d837f97d79c8 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:26.990495 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-904671f1-799d-450a-9e30-d837f97d79c8 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 8ad215fb-dc14-4768-98d9-c57389e0d317] Going to try to terminate instance {{(pid=118117) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 16:44:27.087510 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-904671f1-799d-450a-9e30-d837f97d79c8 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "DELETE /compute/v2.1/servers/8ad215fb-dc14-4768-98d9-c57389e0d317" status: 204 len: 0 microversion: 2.1 time: 0.139302 Aug 01 16:44:27.088586 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 350/711] 10.222.0.45 () {58 vars in 1239 bytes} [Mon Aug 1 16:44:26 2022] DELETE /compute/v2.1/servers/8ad215fb-dc14-4768-98d9-c57389e0d317 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 16:44:27.097498 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-a8884211-8d32-4779-9068-d752d7931c9e tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:44:27.098148 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-a8884211-8d32-4779-9068-d752d7931c9e tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 8ad215fb-dc14-4768-98d9-c57389e0d317] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:44:27.105565 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a8884211-8d32-4779-9068-d752d7931c9e tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:27.106133 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a8884211-8d32-4779-9068-d752d7931c9e tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:27.107004 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a8884211-8d32-4779-9068-d752d7931c9e tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:27.107527 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a8884211-8d32-4779-9068-d752d7931c9e tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:27.270019 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-a8884211-8d32-4779-9068-d752d7931c9e tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac7d3acf1204a9f98f9ee14c2b46a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f46e472f8614c5e847ceb225cc9bff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:44:27.278075 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-a8884211-8d32-4779-9068-d752d7931c9e tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/8ad215fb-dc14-4768-98d9-c57389e0d317" status: 200 len: 1681 microversion: 2.1 time: 0.184517 Aug 01 16:44:27.278846 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 362/712] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:44:27 2022] GET /compute/v2.1/servers/8ad215fb-dc14-4768-98d9-c57389e0d317 => generated 1681 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:44:28.302098 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-4607ba8a-362f-409a-bb12-3394809a188c tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:44:28.302991 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-4607ba8a-362f-409a-bb12-3394809a188c tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 8ad215fb-dc14-4768-98d9-c57389e0d317] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:44:28.311103 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-4607ba8a-362f-409a-bb12-3394809a188c tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:28.311575 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-4607ba8a-362f-409a-bb12-3394809a188c tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:28.312374 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-4607ba8a-362f-409a-bb12-3394809a188c tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:28.312806 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-4607ba8a-362f-409a-bb12-3394809a188c tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:28.329572 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:44:28.461691 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-4607ba8a-362f-409a-bb12-3394809a188c tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac7d3acf1204a9f98f9ee14c2b46a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f46e472f8614c5e847ceb225cc9bff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:44:28.475249 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-4607ba8a-362f-409a-bb12-3394809a188c tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/8ad215fb-dc14-4768-98d9-c57389e0d317" status: 200 len: 1681 microversion: 2.1 time: 0.177225 Aug 01 16:44:28.476362 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 351/713] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:44:28 2022] GET /compute/v2.1/servers/8ad215fb-dc14-4768-98d9-c57389e0d317 => generated 1681 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:44:29.501837 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-595df417-cfb5-4414-8db1-8b019974250d tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:44:29.503630 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-595df417-cfb5-4414-8db1-8b019974250d tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 8ad215fb-dc14-4768-98d9-c57389e0d317] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:44:29.513839 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-595df417-cfb5-4414-8db1-8b019974250d tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:29.514495 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-595df417-cfb5-4414-8db1-8b019974250d tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:29.515523 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-595df417-cfb5-4414-8db1-8b019974250d tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:29.516158 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-595df417-cfb5-4414-8db1-8b019974250d tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:29.809919 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-595df417-cfb5-4414-8db1-8b019974250d tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac7d3acf1204a9f98f9ee14c2b46a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f46e472f8614c5e847ceb225cc9bff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:44:29.825375 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-595df417-cfb5-4414-8db1-8b019974250d tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/8ad215fb-dc14-4768-98d9-c57389e0d317" status: 200 len: 1681 microversion: 2.1 time: 0.328492 Aug 01 16:44:29.826480 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 363/714] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:44:29 2022] GET /compute/v2.1/servers/8ad215fb-dc14-4768-98d9-c57389e0d317 => generated 1681 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:44:30.047104 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [req-a152e07e-2b4e-4e2e-961e-950fbc06165a req-a14e250e-70e0-4009-82ed-0c888fb16c30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ad215fb-dc14-4768-98d9-c57389e0d317", "name": "network-vif-deleted", "tag": "b4171be2-3d4a-4e8a-84b5-cd3bda91a4c0"}]} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:44:30.073519 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-a152e07e-2b4e-4e2e-961e-950fbc06165a req-a14e250e-70e0-4009-82ed-0c888fb16c30 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:30.074825 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-a152e07e-2b4e-4e2e-961e-950fbc06165a req-a14e250e-70e0-4009-82ed-0c888fb16c30 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:30.100251 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.compute.server_external_events [req-a152e07e-2b4e-4e2e-961e-950fbc06165a req-a14e250e-70e0-4009-82ed-0c888fb16c30 service nova] Creating event network-vif-deleted:b4171be2-3d4a-4e8a-84b5-cd3bda91a4c0 for instance 8ad215fb-dc14-4768-98d9-c57389e0d317 on hv-cinder-85032 Aug 01 16:44:30.114819 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [req-a152e07e-2b4e-4e2e-961e-950fbc06165a req-a14e250e-70e0-4009-82ed-0c888fb16c30 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075170 Aug 01 16:44:30.123985 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 352/715] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:44:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:44:30.853989 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-094c72c7-aa97-40c3-89d5-7dccec2bb9ac tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:44:30.854749 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-094c72c7-aa97-40c3-89d5-7dccec2bb9ac tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 8ad215fb-dc14-4768-98d9-c57389e0d317] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:44:30.862774 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-094c72c7-aa97-40c3-89d5-7dccec2bb9ac tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:30.863244 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-094c72c7-aa97-40c3-89d5-7dccec2bb9ac tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:30.864066 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-094c72c7-aa97-40c3-89d5-7dccec2bb9ac tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:30.864508 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-094c72c7-aa97-40c3-89d5-7dccec2bb9ac tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:30.880725 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.wsgi [None req-094c72c7-aa97-40c3-89d5-7dccec2bb9ac tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] HTTP exception thrown: Instance 8ad215fb-dc14-4768-98d9-c57389e0d317 could not be found. Aug 01 16:44:30.882577 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-094c72c7-aa97-40c3-89d5-7dccec2bb9ac tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Request method failure captured: Aug 01 16:44:30.882577 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: request: GET /compute/v2.1/servers/8ad215fb-dc14-4768-98d9-c57389e0d317 HTTP/1.1 Aug 01 16:44:30.882577 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Accept: application/json Aug 01 16:44:30.882577 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Accept-Encoding: identity Aug 01 16:44:30.882577 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Connection: close Aug 01 16:44:30.882577 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Content-Length: 0 Aug 01 16:44:30.882577 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Content-Type: application/json Aug 01 16:44:30.882577 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Host: 10.222.0.45 Aug 01 16:44:30.882577 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Openstack-System-Scope: None Aug 01 16:44:30.882577 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: User-Agent: python-urllib3/1.26.10 Aug 01 16:44:30.882577 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Auth-Token: gAAAAABi6AHCRDGoebg0LS7gmy1eTpjTuQd112Y1pcMjujKk6txGUWSA3OMMaHc1baNi_AdoDEvdhzRnASCOKOmNH90_reDUi0PqBGMG7mNlkYUDBNxMpR2mUAgvvel08FXbCsasfVUCgx1es__sgSc1ixE0JQKf1ZzhFBiBb0upY90FvmppuN0 Aug 01 16:44:30.882577 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Domain-Id: None Aug 01 16:44:30.882577 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Domain-Name: None Aug 01 16:44:30.882577 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Identity-Status: Confirmed Aug 01 16:44:30.882577 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Is-Admin-Project: True Aug 01 16:44:30.882577 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Domain-Id: default Aug 01 16:44:30.882577 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Domain-Name: Default Aug 01 16:44:30.882577 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Id: 2f46e472f8614c5e847ceb225cc9bff1 Aug 01 16:44:30.882577 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Name: tempest-AttachVolumeNegativeTest-597514302 Aug 01 16:44:30.882577 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Role: reader,member Aug 01 16:44:30.882577 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Roles: reader,member Aug 01 16:44:30.885661 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2f46e472f8614c5e847ceb225cc9bff1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2f46e472f8614c5e847ceb225cc9bff1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2f46e472f8614c5e847ceb225cc9bff1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2f46e472f8614c5e847ceb225cc9bff1"}]}] Aug 01 16:44:30.885661 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant: tempest-AttachVolumeNegativeTest-597514302 Aug 01 16:44:30.885661 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant-Id: 2f46e472f8614c5e847ceb225cc9bff1 Aug 01 16:44:30.885661 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-597514302 Aug 01 16:44:30.885661 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User: tempest-AttachVolumeNegativeTest-597514302-project Aug 01 16:44:30.885661 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Domain-Id: default Aug 01 16:44:30.885661 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Domain-Name: Default Aug 01 16:44:30.885661 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Id: 1ac7d3acf1204a9f98f9ee14c2b46a5e Aug 01 16:44:30.885661 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Name: tempest-AttachVolumeNegativeTest-597514302-project Aug 01 16:44:30.885661 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: method: > Aug 01 16:44:30.885661 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: exception: Instance 8ad215fb-dc14-4768-98d9-c57389e0d317 could not be found. Aug 01 16:44:30.885661 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: action_args: {'id': '8ad215fb-dc14-4768-98d9-c57389e0d317'} Aug 01 16:44:30.887817 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:44:30.887817 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:44:30.887817 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 16:44:30.887817 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 16:44:30.887817 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 16:44:30.887817 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 16:44:30.887817 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 16:44:30.887817 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 16:44:30.887817 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 16:44:30.887817 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 16:44:30.887817 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ad215fb-dc14-4768-98d9-c57389e0d317 could not be found. Aug 01 16:44:30.887817 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:44:30.887817 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:44:30.887817 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:44:30.887817 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:44:30.887817 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:44:30.887817 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:44:30.887817 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:44:30.887817 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:44:30.887817 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:44:30.890685 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:44:30.890685 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 16:44:30.890685 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 16:44:30.890685 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 16:44:30.890685 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 16:44:30.890685 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 16:44:30.890685 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:44:30.890685 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ad215fb-dc14-4768-98d9-c57389e0d317 could not be found. Aug 01 16:44:30.890685 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:44:30.890685 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:44:30.890685 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:44:30.890685 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:44:30.890685 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:44:30.890685 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:44:30.890685 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:44:30.890685 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:44:30.890685 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ad215fb-dc14-4768-98d9-c57389e0d317 could not be found. Aug 01 16:44:30.890685 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:44:30.893017 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-094c72c7-aa97-40c3-89d5-7dccec2bb9ac tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Returning 404 to user: Instance 8ad215fb-dc14-4768-98d9-c57389e0d317 could not be found. {{(pid=118118) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:44:30.893017 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-094c72c7-aa97-40c3-89d5-7dccec2bb9ac tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/8ad215fb-dc14-4768-98d9-c57389e0d317" status: 404 len: 111 microversion: 2.1 time: 0.035284 Aug 01 16:44:30.893017 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 364/716] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:44:30 2022] GET /compute/v2.1/servers/8ad215fb-dc14-4768-98d9-c57389e0d317 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 16:44:30.894947 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-1fddd7d8-ec82-4366-9e53-04c85903289b tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '.version_select at 0x7efd5e9d9790>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:44:30.922366 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-1fddd7d8-ec82-4366-9e53-04c85903289b tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1225354786" status: 202 len: 0 microversion: 2.1 time: 0.030724 Aug 01 16:44:30.927058 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 353/717] 10.222.0.45 () {58 vars in 1221 bytes} [Mon Aug 1 16:44:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1225354786 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 01 16:44:31.682646 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-9315c719-fccf-44c4-b11d-79e3ef837b75 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Action: 'create', calling method: .version_select at 0x7efd5ece9280>, body: {"keypair": {"name": "tempest-keypair-902399961", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMJcVTRnBJaPCBrV2ybN2JXD/OmLzYDmQvqNKYLW9ECo2/z39rmucaEwNRhw56gQr7DvwcpGExUScwC6HKC1o0KqHEfu739+e91Cl6TrxVXaOv3c24EQnTW21v8UA6rThw=="}} {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:44:31.698780 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.quota [None req-9315c719-fccf-44c4-b11d-79e3ef837b75 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Getting quotas for project 2f46e472f8614c5e847ceb225cc9bff1. Resources: {'key_pairs'} {{(pid=118118) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 16:44:31.702838 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.quota [None req-9315c719-fccf-44c4-b11d-79e3ef837b75 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Getting quotas for user 1ac7d3acf1204a9f98f9ee14c2b46a5e and project 2f46e472f8614c5e847ceb225cc9bff1. Resources: {'key_pairs'} {{(pid=118118) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 16:44:31.729215 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-9315c719-fccf-44c4-b11d-79e3ef837b75 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.051099 Aug 01 16:44:31.730029 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 365/718] 10.222.0.45 () {60 vars in 1159 bytes} [Mon Aug 1 16:44:31 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 16:44:33.215203 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-b351b990-55c5-4aea-af06-24e67621f1ed tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1503284679", "imageRef": "c9cb5329-85cb-4472-935d-c4ea1d1f0592", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "94e169bb-9307-4057-852a-5a9a3345875b"}], "security_groups": [{"name": "tempest-securitygroup--1000476344"}], "key_name": "tempest-keypair-902399961", "user_data": "}} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:44:33.326399 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.network.neutron [None req-b351b990-55c5-4aea-af06-24e67621f1ed tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] validate_networks() for [('94e169bb-9307-4057-852a-5a9a3345875b', None, None, None, None, None)] {{(pid=118117) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 16:44:33.825070 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.virt.hardware [None req-b351b990-55c5-4aea-af06-24e67621f1ed tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Flavor limits 0:0:0 {{(pid=118117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 16:44:33.825494 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.virt.hardware [None req-b351b990-55c5-4aea-af06-24e67621f1ed tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Image limits 0:0:0 {{(pid=118117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 16:44:33.825989 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.virt.hardware [None req-b351b990-55c5-4aea-af06-24e67621f1ed tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Flavor pref 0:0:0 {{(pid=118117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 16:44:33.826394 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.virt.hardware [None req-b351b990-55c5-4aea-af06-24e67621f1ed tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Image pref 0:0:0 {{(pid=118117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 16:44:33.826801 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.virt.hardware [None req-b351b990-55c5-4aea-af06-24e67621f1ed tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 16:44:33.836768 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-b351b990-55c5-4aea-af06-24e67621f1ed tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:33.837126 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-b351b990-55c5-4aea-af06-24e67621f1ed tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:33.838709 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-b351b990-55c5-4aea-af06-24e67621f1ed tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:33.839140 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-b351b990-55c5-4aea-af06-24e67621f1ed tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:33.864086 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.quota [None req-b351b990-55c5-4aea-af06-24e67621f1ed tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Getting quotas for project 2f46e472f8614c5e847ceb225cc9bff1. Resources: {'cores', 'ram', 'instances'} {{(pid=118117) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 16:44:33.868908 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.quota [None req-b351b990-55c5-4aea-af06-24e67621f1ed tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Getting quotas for user 1ac7d3acf1204a9f98f9ee14c2b46a5e and project 2f46e472f8614c5e847ceb225cc9bff1. Resources: {'cores', 'ram', 'instances'} {{(pid=118117) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 16:44:33.880828 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-b351b990-55c5-4aea-af06-24e67621f1ed tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Going to run 1 instances... {{(pid=118117) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 16:44:33.883246 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-b351b990-55c5-4aea-af06-24e67621f1ed tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 064171b4-a8a9-498c-bbd9-f51ff91afdc7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c9cb5329-85cb-4472-935d-c4ea1d1f0592',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118117) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 16:44:33.931685 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-b351b990-55c5-4aea-af06-24e67621f1ed tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.721287 Aug 01 16:44:33.932660 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 354/719] 10.222.0.45 () {60 vars in 1147 bytes} [Mon Aug 1 16:44:33 2022] POST /compute/v2.1/servers => generated 402 bytes in 723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 16:44:33.944217 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-10e61a7e-ef2d-4e92-8146-6d5c4eaf0554 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:44:33.945208 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-10e61a7e-ef2d-4e92-8146-6d5c4eaf0554 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 064171b4-a8a9-498c-bbd9-f51ff91afdc7] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:44:34.011851 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-10e61a7e-ef2d-4e92-8146-6d5c4eaf0554 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac7d3acf1204a9f98f9ee14c2b46a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f46e472f8614c5e847ceb225cc9bff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:44:34.018938 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-10e61a7e-ef2d-4e92-8146-6d5c4eaf0554 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/064171b4-a8a9-498c-bbd9-f51ff91afdc7" status: 200 len: 1241 microversion: 2.1 time: 0.079231 Aug 01 16:44:34.019622 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 366/720] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:44:33 2022] GET /compute/v2.1/servers/064171b4-a8a9-498c-bbd9-f51ff91afdc7 => generated 1241 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:44:35.041699 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-c302eb4a-39f4-47a9-a665-01174186ea1d tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:44:35.042324 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-c302eb4a-39f4-47a9-a665-01174186ea1d tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 064171b4-a8a9-498c-bbd9-f51ff91afdc7] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:44:35.044497 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:44:35.050840 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-c302eb4a-39f4-47a9-a665-01174186ea1d tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:35.051281 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-c302eb4a-39f4-47a9-a665-01174186ea1d tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:35.052109 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-c302eb4a-39f4-47a9-a665-01174186ea1d tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:35.052554 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-c302eb4a-39f4-47a9-a665-01174186ea1d tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:35.122071 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-c302eb4a-39f4-47a9-a665-01174186ea1d tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac7d3acf1204a9f98f9ee14c2b46a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f46e472f8614c5e847ceb225cc9bff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:44:35.131714 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-c302eb4a-39f4-47a9-a665-01174186ea1d tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/064171b4-a8a9-498c-bbd9-f51ff91afdc7" status: 200 len: 1293 microversion: 2.1 time: 0.094693 Aug 01 16:44:35.132420 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 355/721] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:44:35 2022] GET /compute/v2.1/servers/064171b4-a8a9-498c-bbd9-f51ff91afdc7 => generated 1293 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:44:36.154165 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-eef0ce39-048e-43b4-a0e1-3eaf9423f659 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:44:36.154731 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-eef0ce39-048e-43b4-a0e1-3eaf9423f659 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 064171b4-a8a9-498c-bbd9-f51ff91afdc7] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:44:36.161441 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-eef0ce39-048e-43b4-a0e1-3eaf9423f659 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:36.162100 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-eef0ce39-048e-43b4-a0e1-3eaf9423f659 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:36.163051 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-eef0ce39-048e-43b4-a0e1-3eaf9423f659 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:36.163489 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-eef0ce39-048e-43b4-a0e1-3eaf9423f659 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:36.166633 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:44:36.383876 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-eef0ce39-048e-43b4-a0e1-3eaf9423f659 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac7d3acf1204a9f98f9ee14c2b46a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f46e472f8614c5e847ceb225cc9bff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:44:36.391983 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-eef0ce39-048e-43b4-a0e1-3eaf9423f659 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/064171b4-a8a9-498c-bbd9-f51ff91afdc7" status: 200 len: 1367 microversion: 2.1 time: 0.241787 Aug 01 16:44:36.392564 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 367/722] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:44:36 2022] GET /compute/v2.1/servers/064171b4-a8a9-498c-bbd9-f51ff91afdc7 => generated 1367 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:44:36.737625 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [req-38005cdb-b50b-41a1-8e03-a530266ddd37 req-5ae13807-919a-4347-bfa5-cdfabe269dfc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "064171b4-a8a9-498c-bbd9-f51ff91afdc7", "tag": "a331a8b4-f92d-457c-aef9-7ba33b18d041"}]} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:44:36.752084 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-38005cdb-b50b-41a1-8e03-a530266ddd37 req-5ae13807-919a-4347-bfa5-cdfabe269dfc service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:36.752525 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-38005cdb-b50b-41a1-8e03-a530266ddd37 req-5ae13807-919a-4347-bfa5-cdfabe269dfc service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:36.764764 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.compute.server_external_events [req-38005cdb-b50b-41a1-8e03-a530266ddd37 req-5ae13807-919a-4347-bfa5-cdfabe269dfc service nova] Creating event network-changed:a331a8b4-f92d-457c-aef9-7ba33b18d041 for instance 064171b4-a8a9-498c-bbd9-f51ff91afdc7 on hv-cinder-85032 Aug 01 16:44:36.779155 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [req-38005cdb-b50b-41a1-8e03-a530266ddd37 req-5ae13807-919a-4347-bfa5-cdfabe269dfc service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045542 Aug 01 16:44:36.780351 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 356/723] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:44:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:44:37.473839 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-32ed530f-e24b-430f-a7c3-0a8c42b12820 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:44:37.475215 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-32ed530f-e24b-430f-a7c3-0a8c42b12820 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 064171b4-a8a9-498c-bbd9-f51ff91afdc7] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:44:37.481877 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-32ed530f-e24b-430f-a7c3-0a8c42b12820 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:37.482322 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-32ed530f-e24b-430f-a7c3-0a8c42b12820 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:37.483192 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-32ed530f-e24b-430f-a7c3-0a8c42b12820 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:37.483618 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-32ed530f-e24b-430f-a7c3-0a8c42b12820 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:37.627739 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-32ed530f-e24b-430f-a7c3-0a8c42b12820 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac7d3acf1204a9f98f9ee14c2b46a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f46e472f8614c5e847ceb225cc9bff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:44:37.638040 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-32ed530f-e24b-430f-a7c3-0a8c42b12820 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/064171b4-a8a9-498c-bbd9-f51ff91afdc7" status: 200 len: 1367 microversion: 2.1 time: 0.228156 Aug 01 16:44:37.638634 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 368/724] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:44:37 2022] GET /compute/v2.1/servers/064171b4-a8a9-498c-bbd9-f51ff91afdc7 => generated 1367 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:44:38.665259 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-f73105ae-6644-420f-b47f-9872b1ca57a1 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:44:38.665982 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-f73105ae-6644-420f-b47f-9872b1ca57a1 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 064171b4-a8a9-498c-bbd9-f51ff91afdc7] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:44:38.681160 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-f73105ae-6644-420f-b47f-9872b1ca57a1 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:38.681746 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-f73105ae-6644-420f-b47f-9872b1ca57a1 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:38.682667 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-f73105ae-6644-420f-b47f-9872b1ca57a1 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:38.683196 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-f73105ae-6644-420f-b47f-9872b1ca57a1 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:38.910217 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-f73105ae-6644-420f-b47f-9872b1ca57a1 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac7d3acf1204a9f98f9ee14c2b46a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f46e472f8614c5e847ceb225cc9bff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:44:38.918727 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-f73105ae-6644-420f-b47f-9872b1ca57a1 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/064171b4-a8a9-498c-bbd9-f51ff91afdc7" status: 200 len: 1367 microversion: 2.1 time: 0.259202 Aug 01 16:44:38.919330 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 357/725] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:44:38 2022] GET /compute/v2.1/servers/064171b4-a8a9-498c-bbd9-f51ff91afdc7 => generated 1367 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:44:39.941501 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-fc0a0209-e3a7-45c2-8b04-d56ace333e02 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:44:39.942067 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-fc0a0209-e3a7-45c2-8b04-d56ace333e02 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 064171b4-a8a9-498c-bbd9-f51ff91afdc7] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:44:39.949743 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-fc0a0209-e3a7-45c2-8b04-d56ace333e02 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:39.950195 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-fc0a0209-e3a7-45c2-8b04-d56ace333e02 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:39.950991 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-fc0a0209-e3a7-45c2-8b04-d56ace333e02 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:39.951427 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-fc0a0209-e3a7-45c2-8b04-d56ace333e02 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:40.092025 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-fc0a0209-e3a7-45c2-8b04-d56ace333e02 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac7d3acf1204a9f98f9ee14c2b46a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f46e472f8614c5e847ceb225cc9bff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:44:40.100127 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-fc0a0209-e3a7-45c2-8b04-d56ace333e02 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/064171b4-a8a9-498c-bbd9-f51ff91afdc7" status: 200 len: 1367 microversion: 2.1 time: 0.162659 Aug 01 16:44:40.100695 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 369/726] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:44:39 2022] GET /compute/v2.1/servers/064171b4-a8a9-498c-bbd9-f51ff91afdc7 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:44:41.094915 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-2a5a4891-a767-48a9-8104-e912ee63ede7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:44:41.095462 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-2a5a4891-a767-48a9-8104-e912ee63ede7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: 87f86dcf-be4f-4fb9-9957-d2c5c10d999c] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:44:41.103457 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-2a5a4891-a767-48a9-8104-e912ee63ede7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:41.103942 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-2a5a4891-a767-48a9-8104-e912ee63ede7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:41.104722 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-2a5a4891-a767-48a9-8104-e912ee63ede7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:41.105158 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-2a5a4891-a767-48a9-8104-e912ee63ede7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:41.125788 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-db4e90c4-b92a-41da-b888-0586fbce3884 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:44:41.126421 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-db4e90c4-b92a-41da-b888-0586fbce3884 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 064171b4-a8a9-498c-bbd9-f51ff91afdc7] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:44:41.133777 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-db4e90c4-b92a-41da-b888-0586fbce3884 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:41.134846 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-db4e90c4-b92a-41da-b888-0586fbce3884 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:41.135724 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-db4e90c4-b92a-41da-b888-0586fbce3884 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:41.136186 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-db4e90c4-b92a-41da-b888-0586fbce3884 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:41.198277 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.objects.instance [None req-2a5a4891-a767-48a9-8104-e912ee63ede7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lazy-loading 'services' on Instance uuid 87f86dcf-be4f-4fb9-9957-d2c5c10d999c {{(pid=118117) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 16:44:41.280253 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-2a5a4891-a767-48a9-8104-e912ee63ede7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "DELETE /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c/os-volume_attachments/fd05abf8-7d80-4794-aea2-328213fe337b" status: 202 len: 0 microversion: 2.1 time: 0.189513 Aug 01 16:44:41.280847 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 358/727] 10.222.0.45 () {58 vars in 1416 bytes} [Mon Aug 1 16:44:41 2022] DELETE /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c/os-volume_attachments/fd05abf8-7d80-4794-aea2-328213fe337b => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 16:44:41.287959 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-db4e90c4-b92a-41da-b888-0586fbce3884 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac7d3acf1204a9f98f9ee14c2b46a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f46e472f8614c5e847ceb225cc9bff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:44:41.291793 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-e10b692d-221b-4d90-94e1-845d6a09559e tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:44:41.294211 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-e10b692d-221b-4d90-94e1-845d6a09559e tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: 87f86dcf-be4f-4fb9-9957-d2c5c10d999c] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:44:41.296315 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-db4e90c4-b92a-41da-b888-0586fbce3884 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/064171b4-a8a9-498c-bbd9-f51ff91afdc7" status: 200 len: 1367 microversion: 2.1 time: 0.177646 Aug 01 16:44:41.296889 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 370/728] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:44:41 2022] GET /compute/v2.1/servers/064171b4-a8a9-498c-bbd9-f51ff91afdc7 => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:44:41.314403 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-e10b692d-221b-4d90-94e1-845d6a09559e tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:41.314757 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-e10b692d-221b-4d90-94e1-845d6a09559e tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:41.315537 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-e10b692d-221b-4d90-94e1-845d6a09559e tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:41.315986 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-e10b692d-221b-4d90-94e1-845d6a09559e tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:41.350417 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-e10b692d-221b-4d90-94e1-845d6a09559e tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064006 Aug 01 16:44:41.350997 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 359/729] 10.222.0.45 () {58 vars in 1302 bytes} [Mon Aug 1 16:44:41 2022] GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 16:44:42.318846 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-3f633bc0-90e2-4f55-9a20-79f5698cdf1c tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:44:42.319496 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-3f633bc0-90e2-4f55-9a20-79f5698cdf1c tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 064171b4-a8a9-498c-bbd9-f51ff91afdc7] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:44:42.328042 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3f633bc0-90e2-4f55-9a20-79f5698cdf1c tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:42.328658 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3f633bc0-90e2-4f55-9a20-79f5698cdf1c tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:42.329710 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3f633bc0-90e2-4f55-9a20-79f5698cdf1c tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:42.330241 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3f633bc0-90e2-4f55-9a20-79f5698cdf1c tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:42.364762 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-e7cd357e-397b-4d9c-8d58-c7653abba6f0 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:44:42.367434 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-e7cd357e-397b-4d9c-8d58-c7653abba6f0 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: 87f86dcf-be4f-4fb9-9957-d2c5c10d999c] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:44:42.375209 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-e7cd357e-397b-4d9c-8d58-c7653abba6f0 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:42.375858 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-e7cd357e-397b-4d9c-8d58-c7653abba6f0 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:42.376749 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-e7cd357e-397b-4d9c-8d58-c7653abba6f0 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:42.377422 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-e7cd357e-397b-4d9c-8d58-c7653abba6f0 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:42.415902 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-e7cd357e-397b-4d9c-8d58-c7653abba6f0 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056467 Aug 01 16:44:42.416861 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 360/730] 10.222.0.45 () {58 vars in 1302 bytes} [Mon Aug 1 16:44:42 2022] GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 16:44:42.491153 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-3f633bc0-90e2-4f55-9a20-79f5698cdf1c tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac7d3acf1204a9f98f9ee14c2b46a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f46e472f8614c5e847ceb225cc9bff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:44:42.501692 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-b39bc5bf-0a3b-4fa1-9462-8b9dbcc1d593 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:44:42.502382 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-b39bc5bf-0a3b-4fa1-9462-8b9dbcc1d593 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: 87f86dcf-be4f-4fb9-9957-d2c5c10d999c] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:44:42.507236 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-3f633bc0-90e2-4f55-9a20-79f5698cdf1c tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/064171b4-a8a9-498c-bbd9-f51ff91afdc7" status: 200 len: 1367 microversion: 2.1 time: 0.192183 Aug 01 16:44:42.510048 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 371/731] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:44:42 2022] GET /compute/v2.1/servers/064171b4-a8a9-498c-bbd9-f51ff91afdc7 => generated 1367 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:44:42.515077 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [req-fd98a2ae-da93-4176-a988-b249e4df1241 req-a78024ac-90c4-4249-bcdb-94088f8a9ea6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "064171b4-a8a9-498c-bbd9-f51ff91afdc7", "name": "network-vif-plugged", "status": "completed", "tag": "a331a8b4-f92d-457c-aef9-7ba33b18d041"}]} {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:44:42.517836 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-b39bc5bf-0a3b-4fa1-9462-8b9dbcc1d593 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:42.518939 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-b39bc5bf-0a3b-4fa1-9462-8b9dbcc1d593 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:42.520505 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-b39bc5bf-0a3b-4fa1-9462-8b9dbcc1d593 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:42.521195 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-b39bc5bf-0a3b-4fa1-9462-8b9dbcc1d593 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:42.526282 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-fd98a2ae-da93-4176-a988-b249e4df1241 req-a78024ac-90c4-4249-bcdb-94088f8a9ea6 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:42.527134 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-fd98a2ae-da93-4176-a988-b249e4df1241 req-a78024ac-90c4-4249-bcdb-94088f8a9ea6 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:42.540522 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.compute.server_external_events [req-fd98a2ae-da93-4176-a988-b249e4df1241 req-a78024ac-90c4-4249-bcdb-94088f8a9ea6 service nova] Creating event network-vif-plugged:a331a8b4-f92d-457c-aef9-7ba33b18d041 for instance 064171b4-a8a9-498c-bbd9-f51ff91afdc7 on hv-cinder-85032 Aug 01 16:44:42.553418 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [req-fd98a2ae-da93-4176-a988-b249e4df1241 req-a78024ac-90c4-4249-bcdb-94088f8a9ea6 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041716 Aug 01 16:44:42.554069 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 372/732] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:44:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:44:42.560359 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-b39bc5bf-0a3b-4fa1-9462-8b9dbcc1d593 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: 87f86dcf-be4f-4fb9-9957-d2c5c10d999c] Going to try to terminate instance {{(pid=118117) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 16:44:42.651316 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-b39bc5bf-0a3b-4fa1-9462-8b9dbcc1d593 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "DELETE /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c" status: 204 len: 0 microversion: 2.1 time: 0.153076 Aug 01 16:44:42.652401 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 361/733] 10.222.0.45 () {58 vars in 1239 bytes} [Mon Aug 1 16:44:42 2022] DELETE /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 01 16:44:42.661901 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-2806f473-4052-4539-8c11-223335e7d92a tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:44:42.662601 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-2806f473-4052-4539-8c11-223335e7d92a tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: 87f86dcf-be4f-4fb9-9957-d2c5c10d999c] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:44:42.670262 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-2806f473-4052-4539-8c11-223335e7d92a tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:42.670707 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-2806f473-4052-4539-8c11-223335e7d92a tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:42.671488 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-2806f473-4052-4539-8c11-223335e7d92a tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:42.671944 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-2806f473-4052-4539-8c11-223335e7d92a tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:42.811505 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-2806f473-4052-4539-8c11-223335e7d92a tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:44:42.819514 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-2806f473-4052-4539-8c11-223335e7d92a tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c" status: 200 len: 1691 microversion: 2.1 time: 0.162253 Aug 01 16:44:42.821508 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 373/734] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:44:42 2022] GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c => generated 1691 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:44:43.529083 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-aac6cd23-3e29-4711-9028-93ed280a28ec tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:44:43.529946 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-aac6cd23-3e29-4711-9028-93ed280a28ec tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 064171b4-a8a9-498c-bbd9-f51ff91afdc7] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:44:43.537405 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-aac6cd23-3e29-4711-9028-93ed280a28ec tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:43.537863 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-aac6cd23-3e29-4711-9028-93ed280a28ec tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:43.538644 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-aac6cd23-3e29-4711-9028-93ed280a28ec tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:43.539202 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-aac6cd23-3e29-4711-9028-93ed280a28ec tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:43.702167 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-aac6cd23-3e29-4711-9028-93ed280a28ec tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac7d3acf1204a9f98f9ee14c2b46a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f46e472f8614c5e847ceb225cc9bff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:44:43.710287 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-aac6cd23-3e29-4711-9028-93ed280a28ec tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/064171b4-a8a9-498c-bbd9-f51ff91afdc7" status: 200 len: 1367 microversion: 2.1 time: 0.185425 Aug 01 16:44:43.710861 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 362/735] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:44:43 2022] GET /compute/v2.1/servers/064171b4-a8a9-498c-bbd9-f51ff91afdc7 => generated 1367 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:44:43.841184 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-53f0a0a3-012c-4849-80c1-7f358e4280fc tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:44:43.841789 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-53f0a0a3-012c-4849-80c1-7f358e4280fc tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: 87f86dcf-be4f-4fb9-9957-d2c5c10d999c] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:44:43.848734 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-53f0a0a3-012c-4849-80c1-7f358e4280fc tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:43.849180 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-53f0a0a3-012c-4849-80c1-7f358e4280fc tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:43.849946 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-53f0a0a3-012c-4849-80c1-7f358e4280fc tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:43.850374 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-53f0a0a3-012c-4849-80c1-7f358e4280fc tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:43.993667 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-53f0a0a3-012c-4849-80c1-7f358e4280fc tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:44:44.001580 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-53f0a0a3-012c-4849-80c1-7f358e4280fc tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c" status: 200 len: 1691 microversion: 2.1 time: 0.165059 Aug 01 16:44:44.002160 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 374/736] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:44:43 2022] GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c => generated 1691 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:44:44.733444 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-4c14bd53-f967-4de6-ba76-4a5dd2f67694 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:44:44.734023 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-4c14bd53-f967-4de6-ba76-4a5dd2f67694 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 064171b4-a8a9-498c-bbd9-f51ff91afdc7] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:44:44.736245 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_cell0:SELECT=2 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:44:44.736960 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_cell0:SELECT=6 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:44:44.746421 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-4c14bd53-f967-4de6-ba76-4a5dd2f67694 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:44.746882 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-4c14bd53-f967-4de6-ba76-4a5dd2f67694 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:44.747663 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-4c14bd53-f967-4de6-ba76-4a5dd2f67694 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:44.748122 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-4c14bd53-f967-4de6-ba76-4a5dd2f67694 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:44.893591 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-4c14bd53-f967-4de6-ba76-4a5dd2f67694 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac7d3acf1204a9f98f9ee14c2b46a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f46e472f8614c5e847ceb225cc9bff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:44:44.901663 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-4c14bd53-f967-4de6-ba76-4a5dd2f67694 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/064171b4-a8a9-498c-bbd9-f51ff91afdc7" status: 200 len: 1367 microversion: 2.1 time: 0.172441 Aug 01 16:44:44.902258 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 363/737] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:44:44 2022] GET /compute/v2.1/servers/064171b4-a8a9-498c-bbd9-f51ff91afdc7 => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:44:45.023603 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-cf426ae4-aba5-4ce0-8c23-6df7cab796bd tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:44:45.024798 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-cf426ae4-aba5-4ce0-8c23-6df7cab796bd tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: 87f86dcf-be4f-4fb9-9957-d2c5c10d999c] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:44:45.027176 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_cell0:SELECT=6 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:44:45.033548 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-cf426ae4-aba5-4ce0-8c23-6df7cab796bd tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:45.033994 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-cf426ae4-aba5-4ce0-8c23-6df7cab796bd tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:45.034764 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-cf426ae4-aba5-4ce0-8c23-6df7cab796bd tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:45.035193 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-cf426ae4-aba5-4ce0-8c23-6df7cab796bd tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:45.174678 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-cf426ae4-aba5-4ce0-8c23-6df7cab796bd tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:44:45.182945 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-cf426ae4-aba5-4ce0-8c23-6df7cab796bd tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c" status: 200 len: 1691 microversion: 2.1 time: 0.163348 Aug 01 16:44:45.183521 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 375/738] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:44:45 2022] GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c => generated 1691 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:44:45.923991 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-68fa9b6e-7934-4e9f-8ac0-ba05985b060c tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:44:45.924578 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-68fa9b6e-7934-4e9f-8ac0-ba05985b060c tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 064171b4-a8a9-498c-bbd9-f51ff91afdc7] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:44:45.931851 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-68fa9b6e-7934-4e9f-8ac0-ba05985b060c tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:45.932349 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-68fa9b6e-7934-4e9f-8ac0-ba05985b060c tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:45.933121 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-68fa9b6e-7934-4e9f-8ac0-ba05985b060c tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:45.933550 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-68fa9b6e-7934-4e9f-8ac0-ba05985b060c tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:46.099045 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-68fa9b6e-7934-4e9f-8ac0-ba05985b060c tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac7d3acf1204a9f98f9ee14c2b46a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f46e472f8614c5e847ceb225cc9bff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:44:46.107428 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-68fa9b6e-7934-4e9f-8ac0-ba05985b060c tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/064171b4-a8a9-498c-bbd9-f51ff91afdc7" status: 200 len: 1367 microversion: 2.1 time: 0.187554 Aug 01 16:44:46.108051 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 364/739] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:44:45 2022] GET /compute/v2.1/servers/064171b4-a8a9-498c-bbd9-f51ff91afdc7 => generated 1367 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:44:46.204893 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-c9c0a28c-bed3-4d70-a2c7-d8e116b90022 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:44:46.205487 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-c9c0a28c-bed3-4d70-a2c7-d8e116b90022 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: 87f86dcf-be4f-4fb9-9957-d2c5c10d999c] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:44:46.212494 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-c9c0a28c-bed3-4d70-a2c7-d8e116b90022 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:46.212932 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-c9c0a28c-bed3-4d70-a2c7-d8e116b90022 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:46.213690 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-c9c0a28c-bed3-4d70-a2c7-d8e116b90022 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:46.214116 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-c9c0a28c-bed3-4d70-a2c7-d8e116b90022 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:46.354539 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-c9c0a28c-bed3-4d70-a2c7-d8e116b90022 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:44:46.363255 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-c9c0a28c-bed3-4d70-a2c7-d8e116b90022 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c" status: 200 len: 1691 microversion: 2.1 time: 0.162264 Aug 01 16:44:46.363956 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 376/740] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:44:46 2022] GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c => generated 1691 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:44:47.128827 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-2186ae8c-ad7b-40df-aecb-752cd44187a5 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:44:47.129387 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-2186ae8c-ad7b-40df-aecb-752cd44187a5 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 064171b4-a8a9-498c-bbd9-f51ff91afdc7] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:44:47.136521 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-2186ae8c-ad7b-40df-aecb-752cd44187a5 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:47.137344 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-2186ae8c-ad7b-40df-aecb-752cd44187a5 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:47.138148 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-2186ae8c-ad7b-40df-aecb-752cd44187a5 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:47.138574 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-2186ae8c-ad7b-40df-aecb-752cd44187a5 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:47.386638 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-10d48299-755b-43e5-be3d-e2db1107fd1f tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:44:47.387886 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-2186ae8c-ad7b-40df-aecb-752cd44187a5 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac7d3acf1204a9f98f9ee14c2b46a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f46e472f8614c5e847ceb225cc9bff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:44:47.394165 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-10d48299-755b-43e5-be3d-e2db1107fd1f tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: 87f86dcf-be4f-4fb9-9957-d2c5c10d999c] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:44:47.398691 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-2186ae8c-ad7b-40df-aecb-752cd44187a5 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/064171b4-a8a9-498c-bbd9-f51ff91afdc7" status: 200 len: 1367 microversion: 2.1 time: 0.273762 Aug 01 16:44:47.399521 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 365/741] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:44:47 2022] GET /compute/v2.1/servers/064171b4-a8a9-498c-bbd9-f51ff91afdc7 => generated 1367 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:44:47.412311 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-10d48299-755b-43e5-be3d-e2db1107fd1f tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:47.412825 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-10d48299-755b-43e5-be3d-e2db1107fd1f tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:47.413794 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-10d48299-755b-43e5-be3d-e2db1107fd1f tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:47.414577 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-10d48299-755b-43e5-be3d-e2db1107fd1f tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:47.416422 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [req-3d9be34c-cd9d-4e52-856b-7ffba8254873 req-fbea94df-dee3-4614-a9f3-f75758ac0684 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87f86dcf-be4f-4fb9-9957-d2c5c10d999c", "name": "network-vif-deleted", "tag": "6e2de669-4a5d-4e6f-be74-46aa73411e81"}]} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:44:47.430304 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-3d9be34c-cd9d-4e52-856b-7ffba8254873 req-fbea94df-dee3-4614-a9f3-f75758ac0684 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:47.431005 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-3d9be34c-cd9d-4e52-856b-7ffba8254873 req-fbea94df-dee3-4614-a9f3-f75758ac0684 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:47.453261 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.compute.server_external_events [req-3d9be34c-cd9d-4e52-856b-7ffba8254873 req-fbea94df-dee3-4614-a9f3-f75758ac0684 service nova] Creating event network-vif-deleted:6e2de669-4a5d-4e6f-be74-46aa73411e81 for instance 87f86dcf-be4f-4fb9-9957-d2c5c10d999c on hv-cinder-85032 Aug 01 16:44:47.460246 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [req-3d9be34c-cd9d-4e52-856b-7ffba8254873 req-fbea94df-dee3-4614-a9f3-f75758ac0684 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052309 Aug 01 16:44:47.461036 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 366/742] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:44:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:44:47.501567 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-10d48299-755b-43e5-be3d-e2db1107fd1f tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:44:47.515691 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-10d48299-755b-43e5-be3d-e2db1107fd1f tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c" status: 200 len: 1623 microversion: 2.1 time: 0.134095 Aug 01 16:44:47.516806 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 377/743] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:44:47 2022] GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c => generated 1623 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:44:48.424069 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-f6ffd3e3-ef0b-4ce6-b822-b8149c257f28 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:44:48.424767 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-f6ffd3e3-ef0b-4ce6-b822-b8149c257f28 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 064171b4-a8a9-498c-bbd9-f51ff91afdc7] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:44:48.432504 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-f6ffd3e3-ef0b-4ce6-b822-b8149c257f28 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:48.432992 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-f6ffd3e3-ef0b-4ce6-b822-b8149c257f28 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:48.433773 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-f6ffd3e3-ef0b-4ce6-b822-b8149c257f28 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:48.434238 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-f6ffd3e3-ef0b-4ce6-b822-b8149c257f28 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:48.539897 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-d26b07cd-bc1a-473e-883d-ed54177beb1d tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:44:48.541563 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-d26b07cd-bc1a-473e-883d-ed54177beb1d tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: 87f86dcf-be4f-4fb9-9957-d2c5c10d999c] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:44:48.548808 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-d26b07cd-bc1a-473e-883d-ed54177beb1d tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:48.549594 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-d26b07cd-bc1a-473e-883d-ed54177beb1d tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:48.550346 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-d26b07cd-bc1a-473e-883d-ed54177beb1d tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:48.550991 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-d26b07cd-bc1a-473e-883d-ed54177beb1d tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:48.568307 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.wsgi [None req-d26b07cd-bc1a-473e-883d-ed54177beb1d tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] HTTP exception thrown: Instance 87f86dcf-be4f-4fb9-9957-d2c5c10d999c could not be found. Aug 01 16:44:48.571471 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-d26b07cd-bc1a-473e-883d-ed54177beb1d tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Request method failure captured: Aug 01 16:44:48.571471 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: request: GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c HTTP/1.1 Aug 01 16:44:48.571471 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Accept: application/json Aug 01 16:44:48.571471 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Accept-Encoding: identity Aug 01 16:44:48.571471 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Connection: close Aug 01 16:44:48.571471 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Content-Length: 0 Aug 01 16:44:48.571471 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Content-Type: application/json Aug 01 16:44:48.571471 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Host: 10.222.0.45 Aug 01 16:44:48.571471 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Openstack-System-Scope: None Aug 01 16:44:48.571471 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: User-Agent: python-urllib3/1.26.10 Aug 01 16:44:48.571471 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Auth-Token: gAAAAABi6AHBHBBMxUjuAe-cwnK815X7ZxuzFHyHjtrk1uJot40PNHiBi2X9YMJeHWohQLbZQ5KLL_REXas2dwpv6zW97hCtQR9_HhjsDDAU83KRBYwvEJCNPLIcHZ71AIrAo_sj1b009gKLC_UwiqB_GoFhYRdPglged0gU-Y7E301TTJaBV1M Aug 01 16:44:48.571471 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Domain-Id: None Aug 01 16:44:48.571471 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Domain-Name: None Aug 01 16:44:48.571471 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Identity-Status: Confirmed Aug 01 16:44:48.571471 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Is-Admin-Project: True Aug 01 16:44:48.571471 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Domain-Id: default Aug 01 16:44:48.571471 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Domain-Name: Default Aug 01 16:44:48.571471 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Id: dbd6814591334db58a37092eb04729fb Aug 01 16:44:48.571471 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1899232052 Aug 01 16:44:48.571471 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Role: reader,member Aug 01 16:44:48.571471 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Roles: reader,member Aug 01 16:44:48.573312 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_dbd6814591334db58a37092eb04729fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/dbd6814591334db58a37092eb04729fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/dbd6814591334db58a37092eb04729fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/dbd6814591334db58a37092eb04729fb"}]}] Aug 01 16:44:48.573312 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1899232052 Aug 01 16:44:48.573312 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant-Id: dbd6814591334db58a37092eb04729fb Aug 01 16:44:48.573312 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1899232052 Aug 01 16:44:48.573312 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User: tempest-ServerRescueNegativeTestJSON-1899232052-project Aug 01 16:44:48.573312 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Domain-Id: default Aug 01 16:44:48.573312 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Domain-Name: Default Aug 01 16:44:48.573312 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Id: 4294d6dff5054da7afcb37b8b28f1a01 Aug 01 16:44:48.573312 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1899232052-project Aug 01 16:44:48.573312 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: method: > Aug 01 16:44:48.573312 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: exception: Instance 87f86dcf-be4f-4fb9-9957-d2c5c10d999c could not be found. Aug 01 16:44:48.573312 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: action_args: {'id': '87f86dcf-be4f-4fb9-9957-d2c5c10d999c'} Aug 01 16:44:48.574249 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:44:48.574249 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:44:48.574249 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 16:44:48.574249 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 16:44:48.574249 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 16:44:48.574249 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 16:44:48.574249 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 16:44:48.574249 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 16:44:48.574249 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 16:44:48.574249 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 16:44:48.574249 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87f86dcf-be4f-4fb9-9957-d2c5c10d999c could not be found. Aug 01 16:44:48.574249 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:44:48.574249 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:44:48.574249 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:44:48.574249 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:44:48.574249 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:44:48.574249 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:44:48.574249 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:44:48.574249 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:44:48.574249 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:44:48.575817 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:44:48.575817 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 16:44:48.575817 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 16:44:48.575817 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 16:44:48.575817 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 16:44:48.575817 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 16:44:48.575817 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:44:48.575817 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87f86dcf-be4f-4fb9-9957-d2c5c10d999c could not be found. Aug 01 16:44:48.575817 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:44:48.575817 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:44:48.575817 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:44:48.575817 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:44:48.575817 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:44:48.575817 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:44:48.575817 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:44:48.575817 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:44:48.575817 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87f86dcf-be4f-4fb9-9957-d2c5c10d999c could not be found. Aug 01 16:44:48.575817 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:44:48.577220 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-d26b07cd-bc1a-473e-883d-ed54177beb1d tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Returning 404 to user: Instance 87f86dcf-be4f-4fb9-9957-d2c5c10d999c could not be found. {{(pid=118118) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:44:48.577220 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-d26b07cd-bc1a-473e-883d-ed54177beb1d tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c" status: 404 len: 111 microversion: 2.1 time: 0.037809 Aug 01 16:44:48.577220 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 378/744] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:44:48 2022] GET /compute/v2.1/servers/87f86dcf-be4f-4fb9-9957-d2c5c10d999c => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 16:44:48.582349 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-c8a12d49-ea30-42dc-a928-c405c4eeb89a tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '.version_select at 0x7efd67530ca0>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:44:48.598467 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-f6ffd3e3-ef0b-4ce6-b822-b8149c257f28 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac7d3acf1204a9f98f9ee14c2b46a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f46e472f8614c5e847ceb225cc9bff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:44:48.607656 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-c8a12d49-ea30-42dc-a928-c405c4eeb89a tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1016633311" status: 202 len: 0 microversion: 2.1 time: 0.029106 Aug 01 16:44:48.608456 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-f6ffd3e3-ef0b-4ce6-b822-b8149c257f28 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/064171b4-a8a9-498c-bbd9-f51ff91afdc7" status: 200 len: 1556 microversion: 2.1 time: 0.188959 Aug 01 16:44:48.612278 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 379/745] 10.222.0.45 () {58 vars in 1221 bytes} [Mon Aug 1 16:44:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1016633311 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 16:44:48.620241 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 367/746] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:44:48 2022] GET /compute/v2.1/servers/064171b4-a8a9-498c-bbd9-f51ff91afdc7 => generated 1556 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:44:48.629427 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-2731ede1-7b23-4858-ab04-d5dcee4bbf46 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:44:48.630023 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-2731ede1-7b23-4858-ab04-d5dcee4bbf46 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 064171b4-a8a9-498c-bbd9-f51ff91afdc7] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:44:48.637655 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-2731ede1-7b23-4858-ab04-d5dcee4bbf46 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:48.638097 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-2731ede1-7b23-4858-ab04-d5dcee4bbf46 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:48.639104 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-2731ede1-7b23-4858-ab04-d5dcee4bbf46 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:48.639516 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-2731ede1-7b23-4858-ab04-d5dcee4bbf46 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:48.768487 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-2731ede1-7b23-4858-ab04-d5dcee4bbf46 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/064171b4-a8a9-498c-bbd9-f51ff91afdc7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.143126 Aug 01 16:44:48.769116 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 380/747] 10.222.0.45 () {58 vars in 1275 bytes} [Mon Aug 1 16:44:48 2022] GET /compute/v2.1/servers/064171b4-a8a9-498c-bbd9-f51ff91afdc7/os-interface => generated 285 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:44:50.146833 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [req-8a8289f4-3932-42e3-b346-153a2de47d98 req-befb1cea-aa30-4a76-a7ba-4c86ae15095e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "064171b4-a8a9-498c-bbd9-f51ff91afdc7", "tag": "a331a8b4-f92d-457c-aef9-7ba33b18d041"}]} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:44:50.158732 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-8a8289f4-3932-42e3-b346-153a2de47d98 req-befb1cea-aa30-4a76-a7ba-4c86ae15095e service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:50.159158 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-8a8289f4-3932-42e3-b346-153a2de47d98 req-befb1cea-aa30-4a76-a7ba-4c86ae15095e service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:50.178758 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.compute.server_external_events [req-8a8289f4-3932-42e3-b346-153a2de47d98 req-befb1cea-aa30-4a76-a7ba-4c86ae15095e service nova] Creating event network-changed:a331a8b4-f92d-457c-aef9-7ba33b18d041 for instance 064171b4-a8a9-498c-bbd9-f51ff91afdc7 on hv-cinder-85032 Aug 01 16:44:50.184764 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [req-8a8289f4-3932-42e3-b346-153a2de47d98 req-befb1cea-aa30-4a76-a7ba-4c86ae15095e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104331 Aug 01 16:44:50.185674 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 368/748] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:44:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 16:44:51.947009 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-8717b3a0-c4f3-4fae-acf7-9f2d0d349190 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:44:51.947784 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-8717b3a0-c4f3-4fae-acf7-9f2d0d349190 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:44:51.954428 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-8717b3a0-c4f3-4fae-acf7-9f2d0d349190 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:51.954870 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-8717b3a0-c4f3-4fae-acf7-9f2d0d349190 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:51.955662 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-8717b3a0-c4f3-4fae-acf7-9f2d0d349190 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:51.956121 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-8717b3a0-c4f3-4fae-acf7-9f2d0d349190 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:51.983934 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-8717b3a0-c4f3-4fae-acf7-9f2d0d349190 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7] Going to try to terminate instance {{(pid=118118) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 16:44:52.072444 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-8717b3a0-c4f3-4fae-acf7-9f2d0d349190 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "DELETE /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7" status: 204 len: 0 microversion: 2.1 time: 0.129474 Aug 01 16:44:52.073123 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 381/749] 10.222.0.45 () {58 vars in 1239 bytes} [Mon Aug 1 16:44:51 2022] DELETE /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 16:44:52.082986 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-bb14f709-5196-4577-8e1b-b66bf28034fd tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:44:52.083710 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-bb14f709-5196-4577-8e1b-b66bf28034fd tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:44:52.090804 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-bb14f709-5196-4577-8e1b-b66bf28034fd tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:52.091241 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-bb14f709-5196-4577-8e1b-b66bf28034fd tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:52.092059 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-bb14f709-5196-4577-8e1b-b66bf28034fd tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:52.092507 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-bb14f709-5196-4577-8e1b-b66bf28034fd tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:52.239221 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-bb14f709-5196-4577-8e1b-b66bf28034fd tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:44:52.249171 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-bb14f709-5196-4577-8e1b-b66bf28034fd tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7" status: 200 len: 1508 microversion: 2.1 time: 0.170913 Aug 01 16:44:52.249945 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 369/750] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:44:52 2022] GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7 => generated 1508 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:44:52.371045 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-c5b5894e-e6cf-4d66-bf87-aad8c5e6b6a2 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:44:52.371630 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-c5b5894e-e6cf-4d66-bf87-aad8c5e6b6a2 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:44:52.378437 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-c5b5894e-e6cf-4d66-bf87-aad8c5e6b6a2 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:52.378880 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-c5b5894e-e6cf-4d66-bf87-aad8c5e6b6a2 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:52.379658 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-c5b5894e-e6cf-4d66-bf87-aad8c5e6b6a2 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:52.380120 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-c5b5894e-e6cf-4d66-bf87-aad8c5e6b6a2 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:52.405649 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-c5b5894e-e6cf-4d66-bf87-aad8c5e6b6a2 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926/ips" status: 200 len: 153 microversion: 2.20 time: 0.166090 Aug 01 16:44:52.406244 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 382/751] 10.222.0.45 () {60 vars in 1289 bytes} [Mon Aug 1 16:44:52 2022] GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926/ips => generated 153 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 16:44:53.276844 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-6b0d37fb-77fa-4773-8284-b0a01d0fb768 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:44:53.277400 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-6b0d37fb-77fa-4773-8284-b0a01d0fb768 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:44:53.284446 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-6b0d37fb-77fa-4773-8284-b0a01d0fb768 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:53.284898 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-6b0d37fb-77fa-4773-8284-b0a01d0fb768 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:53.285657 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-6b0d37fb-77fa-4773-8284-b0a01d0fb768 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:53.286084 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-6b0d37fb-77fa-4773-8284-b0a01d0fb768 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:53.288911 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:44:53.437971 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-6b0d37fb-77fa-4773-8284-b0a01d0fb768 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:44:53.447385 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-6b0d37fb-77fa-4773-8284-b0a01d0fb768 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7" status: 200 len: 1508 microversion: 2.1 time: 0.174613 Aug 01 16:44:53.447997 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 370/752] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:44:53 2022] GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7 => generated 1508 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:44:54.469914 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-c140814f-1f27-4bc1-a31f-4236a05c99ce tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:44:54.470494 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-c140814f-1f27-4bc1-a31f-4236a05c99ce tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:44:54.478065 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-c140814f-1f27-4bc1-a31f-4236a05c99ce tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:54.478560 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-c140814f-1f27-4bc1-a31f-4236a05c99ce tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:54.479370 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-c140814f-1f27-4bc1-a31f-4236a05c99ce tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:54.479796 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-c140814f-1f27-4bc1-a31f-4236a05c99ce tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:54.692796 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-c140814f-1f27-4bc1-a31f-4236a05c99ce tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:44:54.701177 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-c140814f-1f27-4bc1-a31f-4236a05c99ce tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7" status: 200 len: 1508 microversion: 2.1 time: 0.235117 Aug 01 16:44:54.701997 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 383/753] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:44:54 2022] GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7 => generated 1508 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:44:54.722720 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-fe692743-3f50-4adb-8ddb-7118ace48660 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:44:54.723326 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-fe692743-3f50-4adb-8ddb-7118ace48660 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:44:54.731144 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-fe692743-3f50-4adb-8ddb-7118ace48660 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:54.731607 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-fe692743-3f50-4adb-8ddb-7118ace48660 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:54.732414 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-fe692743-3f50-4adb-8ddb-7118ace48660 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:54.732841 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-fe692743-3f50-4adb-8ddb-7118ace48660 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:54.756488 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.objects.instance [None req-fe692743-3f50-4adb-8ddb-7118ace48660 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lazy-loading 'flavor' on Instance uuid 144c8e15-97cd-4e0d-9d60-2ba97c26e926 {{(pid=118117) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 16:44:54.946632 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-fe692743-3f50-4adb-8ddb-7118ace48660 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "POST /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926/action" status: 202 len: 0 microversion: 2.20 time: 0.228061 Aug 01 16:44:54.947333 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 371/754] 10.222.0.45 () {62 vars in 1319 bytes} [Mon Aug 1 16:44:54 2022] POST /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 01 16:44:54.960563 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-b061dbb4-6662-4325-84fb-36f9d1b1e126 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:44:54.961220 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-b061dbb4-6662-4325-84fb-36f9d1b1e126 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:44:54.969730 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-b061dbb4-6662-4325-84fb-36f9d1b1e126 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:54.970167 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-b061dbb4-6662-4325-84fb-36f9d1b1e126 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:54.970941 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-b061dbb4-6662-4325-84fb-36f9d1b1e126 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:54.971363 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-b061dbb4-6662-4325-84fb-36f9d1b1e126 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:55.107518 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [req-8ab1e33e-0f9d-4374-a2c0-30727562b2c0 req-efd893ef-e045-453f-92c1-89601766ab22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7", "name": "network-vif-deleted", "tag": "fe392c22-efae-48fa-84a5-56b4d266ae8b"}]} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:44:55.121097 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-8ab1e33e-0f9d-4374-a2c0-30727562b2c0 req-efd893ef-e045-453f-92c1-89601766ab22 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:55.121532 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-8ab1e33e-0f9d-4374-a2c0-30727562b2c0 req-efd893ef-e045-453f-92c1-89601766ab22 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:55.146075 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.compute.server_external_events [req-8ab1e33e-0f9d-4374-a2c0-30727562b2c0 req-efd893ef-e045-453f-92c1-89601766ab22 service nova] Creating event network-vif-deleted:fe392c22-efae-48fa-84a5-56b4d266ae8b for instance d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7 on hv-cinder-85032 Aug 01 16:44:55.151640 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [req-8ab1e33e-0f9d-4374-a2c0-30727562b2c0 req-efd893ef-e045-453f-92c1-89601766ab22 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049472 Aug 01 16:44:55.152817 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 372/755] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:44:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 16:44:55.193785 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-b061dbb4-6662-4325-84fb-36f9d1b1e126 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:44:55.205058 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-b061dbb4-6662-4325-84fb-36f9d1b1e126 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:44:55.206574 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-b061dbb4-6662-4325-84fb-36f9d1b1e126 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:44:55.207733 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-b061dbb4-6662-4325-84fb-36f9d1b1e126 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926" status: 200 len: 1724 microversion: 2.20 time: 0.255996 Aug 01 16:44:55.208509 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 384/756] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:44:54 2022] GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926 => generated 1724 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:44:55.308768 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-f22fc886-1e8b-40cb-ad2c-482a2d493f88 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:44:55.309348 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-f22fc886-1e8b-40cb-ad2c-482a2d493f88 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: e2e46d25-15d6-4671-8d04-9994875a9f96] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:44:55.315837 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-f22fc886-1e8b-40cb-ad2c-482a2d493f88 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:55.316292 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-f22fc886-1e8b-40cb-ad2c-482a2d493f88 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:55.317047 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-f22fc886-1e8b-40cb-ad2c-482a2d493f88 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:55.317476 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-f22fc886-1e8b-40cb-ad2c-482a2d493f88 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:55.343002 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-f22fc886-1e8b-40cb-ad2c-482a2d493f88 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/e2e46d25-15d6-4671-8d04-9994875a9f96/ips" status: 200 len: 145 microversion: 2.1 time: 0.092585 Aug 01 16:44:55.343571 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 373/757] 10.222.0.45 () {58 vars in 1248 bytes} [Mon Aug 1 16:44:55 2022] GET /compute/v2.1/servers/e2e46d25-15d6-4671-8d04-9994875a9f96/ips => generated 145 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:44:55.723414 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-f92664ba-629c-4769-a7e2-217be040aca3 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:44:55.724017 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-f92664ba-629c-4769-a7e2-217be040aca3 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:44:55.726791 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=1,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:44:55.733790 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-f92664ba-629c-4769-a7e2-217be040aca3 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:55.734448 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-f92664ba-629c-4769-a7e2-217be040aca3 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:55.735231 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-f92664ba-629c-4769-a7e2-217be040aca3 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:55.735642 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-f92664ba-629c-4769-a7e2-217be040aca3 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:55.740211 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:44:55.753112 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.wsgi [None req-f92664ba-629c-4769-a7e2-217be040aca3 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] HTTP exception thrown: Instance d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7 could not be found. Aug 01 16:44:55.755106 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-f92664ba-629c-4769-a7e2-217be040aca3 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Request method failure captured: Aug 01 16:44:55.755106 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: request: GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7 HTTP/1.1 Aug 01 16:44:55.755106 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Accept: application/json Aug 01 16:44:55.755106 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Accept-Encoding: identity Aug 01 16:44:55.755106 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Connection: close Aug 01 16:44:55.755106 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Content-Length: 0 Aug 01 16:44:55.755106 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Content-Type: application/json Aug 01 16:44:55.755106 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Host: 10.222.0.45 Aug 01 16:44:55.755106 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Openstack-System-Scope: None Aug 01 16:44:55.755106 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: User-Agent: python-urllib3/1.26.10 Aug 01 16:44:55.755106 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Auth-Token: gAAAAABi6AHBHBBMxUjuAe-cwnK815X7ZxuzFHyHjtrk1uJot40PNHiBi2X9YMJeHWohQLbZQ5KLL_REXas2dwpv6zW97hCtQR9_HhjsDDAU83KRBYwvEJCNPLIcHZ71AIrAo_sj1b009gKLC_UwiqB_GoFhYRdPglged0gU-Y7E301TTJaBV1M Aug 01 16:44:55.755106 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Domain-Id: None Aug 01 16:44:55.755106 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Domain-Name: None Aug 01 16:44:55.755106 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Identity-Status: Confirmed Aug 01 16:44:55.755106 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Is-Admin-Project: True Aug 01 16:44:55.755106 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Domain-Id: default Aug 01 16:44:55.755106 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Domain-Name: Default Aug 01 16:44:55.755106 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Id: dbd6814591334db58a37092eb04729fb Aug 01 16:44:55.755106 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1899232052 Aug 01 16:44:55.755106 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Role: reader,member Aug 01 16:44:55.755106 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Roles: reader,member Aug 01 16:44:55.756638 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_dbd6814591334db58a37092eb04729fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/dbd6814591334db58a37092eb04729fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/dbd6814591334db58a37092eb04729fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/dbd6814591334db58a37092eb04729fb"}]}] Aug 01 16:44:55.756638 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1899232052 Aug 01 16:44:55.756638 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant-Id: dbd6814591334db58a37092eb04729fb Aug 01 16:44:55.756638 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1899232052 Aug 01 16:44:55.756638 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User: tempest-ServerRescueNegativeTestJSON-1899232052-project Aug 01 16:44:55.756638 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Domain-Id: default Aug 01 16:44:55.756638 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Domain-Name: Default Aug 01 16:44:55.756638 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Id: 4294d6dff5054da7afcb37b8b28f1a01 Aug 01 16:44:55.756638 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1899232052-project Aug 01 16:44:55.756638 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: method: > Aug 01 16:44:55.756638 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: exception: Instance d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7 could not be found. Aug 01 16:44:55.756638 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: action_args: {'id': 'd7bc792a-cbf5-4ec7-91a5-1f9443d1fae7'} Aug 01 16:44:55.757528 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:44:55.757528 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:44:55.757528 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 16:44:55.757528 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 16:44:55.757528 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 16:44:55.757528 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 16:44:55.757528 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 16:44:55.757528 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 16:44:55.757528 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 16:44:55.757528 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 16:44:55.757528 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7 could not be found. Aug 01 16:44:55.757528 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:44:55.757528 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:44:55.757528 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:44:55.757528 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:44:55.757528 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:44:55.757528 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:44:55.757528 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:44:55.757528 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:44:55.757528 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:44:55.759124 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:44:55.759124 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 16:44:55.759124 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 16:44:55.759124 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 16:44:55.759124 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 16:44:55.759124 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 16:44:55.759124 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:44:55.759124 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7 could not be found. Aug 01 16:44:55.759124 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:44:55.759124 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:44:55.759124 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:44:55.759124 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:44:55.759124 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:44:55.759124 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:44:55.759124 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:44:55.759124 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:44:55.759124 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7 could not be found. Aug 01 16:44:55.759124 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:44:55.760454 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-f92664ba-629c-4769-a7e2-217be040aca3 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Returning 404 to user: Instance d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7 could not be found. {{(pid=118118) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:44:55.760454 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-f92664ba-629c-4769-a7e2-217be040aca3 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7" status: 404 len: 111 microversion: 2.1 time: 0.038033 Aug 01 16:44:55.760454 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 385/758] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:44:55 2022] GET /compute/v2.1/servers/d7bc792a-cbf5-4ec7-91a5-1f9443d1fae7 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 16:44:55.766209 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-2e23942d-a287-4870-8519-3b2cca5b71a8 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:44:55.766818 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-2e23942d-a287-4870-8519-3b2cca5b71a8 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: ddf9be16-b3ce-411b-ac14-17dae5f41821] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:44:55.773567 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-2e23942d-a287-4870-8519-3b2cca5b71a8 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:55.774008 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-2e23942d-a287-4870-8519-3b2cca5b71a8 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:55.774936 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-2e23942d-a287-4870-8519-3b2cca5b71a8 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:55.775361 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-2e23942d-a287-4870-8519-3b2cca5b71a8 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:55.801273 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-2e23942d-a287-4870-8519-3b2cca5b71a8 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: ddf9be16-b3ce-411b-ac14-17dae5f41821] Going to try to terminate instance {{(pid=118117) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 16:44:55.882177 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-2e23942d-a287-4870-8519-3b2cca5b71a8 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "DELETE /compute/v2.1/servers/ddf9be16-b3ce-411b-ac14-17dae5f41821" status: 204 len: 0 microversion: 2.1 time: 0.119616 Aug 01 16:44:55.882885 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 374/759] 10.222.0.45 () {58 vars in 1239 bytes} [Mon Aug 1 16:44:55 2022] DELETE /compute/v2.1/servers/ddf9be16-b3ce-411b-ac14-17dae5f41821 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 16:44:55.893593 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-066df1df-fca8-4b82-9a38-d9a0b007a33f tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:44:55.894195 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-066df1df-fca8-4b82-9a38-d9a0b007a33f tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: ddf9be16-b3ce-411b-ac14-17dae5f41821] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:44:55.902297 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-066df1df-fca8-4b82-9a38-d9a0b007a33f tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:55.902815 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-066df1df-fca8-4b82-9a38-d9a0b007a33f tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:55.903734 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-066df1df-fca8-4b82-9a38-d9a0b007a33f tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:55.904306 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-066df1df-fca8-4b82-9a38-d9a0b007a33f tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:56.048248 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-066df1df-fca8-4b82-9a38-d9a0b007a33f tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:44:56.056366 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-066df1df-fca8-4b82-9a38-d9a0b007a33f tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/ddf9be16-b3ce-411b-ac14-17dae5f41821" status: 200 len: 1521 microversion: 2.1 time: 0.168500 Aug 01 16:44:56.056940 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 386/760] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:44:55 2022] GET /compute/v2.1/servers/ddf9be16-b3ce-411b-ac14-17dae5f41821 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:44:56.235021 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-38ed4e8a-cc23-4304-b141-ed4d9f335cae tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:44:56.236024 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-38ed4e8a-cc23-4304-b141-ed4d9f335cae tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:44:56.244383 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-38ed4e8a-cc23-4304-b141-ed4d9f335cae tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:56.244728 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-38ed4e8a-cc23-4304-b141-ed4d9f335cae tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:56.245512 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-38ed4e8a-cc23-4304-b141-ed4d9f335cae tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:56.245943 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-38ed4e8a-cc23-4304-b141-ed4d9f335cae tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:56.389210 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-38ed4e8a-cc23-4304-b141-ed4d9f335cae tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:44:56.397452 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-38ed4e8a-cc23-4304-b141-ed4d9f335cae tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:44:56.399106 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-38ed4e8a-cc23-4304-b141-ed4d9f335cae tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:44:56.400317 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-38ed4e8a-cc23-4304-b141-ed4d9f335cae tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926" status: 200 len: 1724 microversion: 2.20 time: 0.171000 Aug 01 16:44:56.400881 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 375/761] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:44:56 2022] GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:44:56.747592 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-6dedbe91-d42e-4104-ba45-df70ff5a0e9a tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ed6e5785-40e9-4f89-9318-b45f3c5733cf"}} {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:44:56.750104 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-6dedbe91-d42e-4104-ba45-df70ff5a0e9a tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: e2e46d25-15d6-4671-8d04-9994875a9f96] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:44:56.757317 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-6dedbe91-d42e-4104-ba45-df70ff5a0e9a tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:56.757808 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-6dedbe91-d42e-4104-ba45-df70ff5a0e9a tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:56.758684 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-6dedbe91-d42e-4104-ba45-df70ff5a0e9a tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:56.759194 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-6dedbe91-d42e-4104-ba45-df70ff5a0e9a tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:57.077664 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-89e2761b-b362-4877-99d9-b7118ee911ec tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:44:57.078303 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-89e2761b-b362-4877-99d9-b7118ee911ec tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: ddf9be16-b3ce-411b-ac14-17dae5f41821] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:44:57.085554 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-89e2761b-b362-4877-99d9-b7118ee911ec tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:57.086264 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-89e2761b-b362-4877-99d9-b7118ee911ec tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:57.087425 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-89e2761b-b362-4877-99d9-b7118ee911ec tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:57.087899 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-89e2761b-b362-4877-99d9-b7118ee911ec tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:57.233928 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-89e2761b-b362-4877-99d9-b7118ee911ec tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:44:57.241842 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-89e2761b-b362-4877-99d9-b7118ee911ec tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/ddf9be16-b3ce-411b-ac14-17dae5f41821" status: 200 len: 1521 microversion: 2.1 time: 0.168488 Aug 01 16:44:57.243164 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 376/762] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:44:57 2022] GET /compute/v2.1/servers/ddf9be16-b3ce-411b-ac14-17dae5f41821 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:44:57.423538 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-ce8b5d69-19a0-4fb4-845c-dab5f2837ee0 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:44:57.424199 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-ce8b5d69-19a0-4fb4-845c-dab5f2837ee0 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:44:57.431418 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-ce8b5d69-19a0-4fb4-845c-dab5f2837ee0 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:57.431900 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-ce8b5d69-19a0-4fb4-845c-dab5f2837ee0 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:57.432672 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-ce8b5d69-19a0-4fb4-845c-dab5f2837ee0 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:57.433107 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-ce8b5d69-19a0-4fb4-845c-dab5f2837ee0 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:57.577139 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-ce8b5d69-19a0-4fb4-845c-dab5f2837ee0 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:44:57.585481 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-ce8b5d69-19a0-4fb4-845c-dab5f2837ee0 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:44:57.587000 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-ce8b5d69-19a0-4fb4-845c-dab5f2837ee0 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:44:57.588197 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-ce8b5d69-19a0-4fb4-845c-dab5f2837ee0 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926" status: 200 len: 1724 microversion: 2.20 time: 0.168607 Aug 01 16:44:57.588762 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 377/763] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:44:57 2022] GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:44:58.230190 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-6dedbe91-d42e-4104-ba45-df70ff5a0e9a tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "POST /compute/v2.1/servers/e2e46d25-15d6-4671-8d04-9994875a9f96/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.486521 Aug 01 16:44:58.235034 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 387/764] 10.222.0.45 () {60 vars in 1323 bytes} [Mon Aug 1 16:44:56 2022] POST /compute/v2.1/servers/e2e46d25-15d6-4671-8d04-9994875a9f96/os-volume_attachments => generated 194 bytes in 1489 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:44:58.263618 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-5a64f8ca-0b15-4516-9b8d-822c6aab63d7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:44:58.264307 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-5a64f8ca-0b15-4516-9b8d-822c6aab63d7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: ddf9be16-b3ce-411b-ac14-17dae5f41821] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:44:58.270970 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-5a64f8ca-0b15-4516-9b8d-822c6aab63d7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:58.271420 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-5a64f8ca-0b15-4516-9b8d-822c6aab63d7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:58.272233 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-5a64f8ca-0b15-4516-9b8d-822c6aab63d7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:58.272666 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-5a64f8ca-0b15-4516-9b8d-822c6aab63d7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:58.435842 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-5a64f8ca-0b15-4516-9b8d-822c6aab63d7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4294d6dff5054da7afcb37b8b28f1a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd6814591334db58a37092eb04729fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:44:58.443930 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-5a64f8ca-0b15-4516-9b8d-822c6aab63d7 tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/ddf9be16-b3ce-411b-ac14-17dae5f41821" status: 200 len: 1521 microversion: 2.1 time: 0.183946 Aug 01 16:44:58.444516 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 378/765] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:44:58 2022] GET /compute/v2.1/servers/ddf9be16-b3ce-411b-ac14-17dae5f41821 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:44:58.613124 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-231b6721-797a-4eec-83d5-3052c2785d9a tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:44:58.613816 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-231b6721-797a-4eec-83d5-3052c2785d9a tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:44:58.620708 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-231b6721-797a-4eec-83d5-3052c2785d9a tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:58.621118 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-231b6721-797a-4eec-83d5-3052c2785d9a tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:58.621876 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-231b6721-797a-4eec-83d5-3052c2785d9a tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:58.622338 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-231b6721-797a-4eec-83d5-3052c2785d9a tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:58.820653 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-231b6721-797a-4eec-83d5-3052c2785d9a tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:44:58.829103 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-231b6721-797a-4eec-83d5-3052c2785d9a tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:44:58.830587 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-231b6721-797a-4eec-83d5-3052c2785d9a tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:44:58.831721 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-231b6721-797a-4eec-83d5-3052c2785d9a tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926" status: 200 len: 1724 microversion: 2.20 time: 0.223473 Aug 01 16:44:58.832301 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 388/766] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:44:58 2022] GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926 => generated 1724 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:44:59.022453 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [req-35ac63ca-1ae1-4c59-bb1a-cbecd334888e req-cdd3a3a6-6eec-426a-9371-f0cc3ad96db6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddf9be16-b3ce-411b-ac14-17dae5f41821", "name": "network-vif-deleted", "tag": "896a3303-311c-4912-963a-aaa4ea080415"}]} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:44:59.033062 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-35ac63ca-1ae1-4c59-bb1a-cbecd334888e req-cdd3a3a6-6eec-426a-9371-f0cc3ad96db6 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:59.033497 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-35ac63ca-1ae1-4c59-bb1a-cbecd334888e req-cdd3a3a6-6eec-426a-9371-f0cc3ad96db6 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:59.045409 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.compute.server_external_events [req-35ac63ca-1ae1-4c59-bb1a-cbecd334888e req-cdd3a3a6-6eec-426a-9371-f0cc3ad96db6 service nova] Creating event network-vif-deleted:896a3303-311c-4912-963a-aaa4ea080415 for instance ddf9be16-b3ce-411b-ac14-17dae5f41821 on hv-cinder-85032 Aug 01 16:44:59.050154 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [req-35ac63ca-1ae1-4c59-bb1a-cbecd334888e req-cdd3a3a6-6eec-426a-9371-f0cc3ad96db6 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094403 Aug 01 16:44:59.050789 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 379/767] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:44:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:44:59.466902 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-a4726483-35bf-4615-9aa0-b3148203b68f tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:44:59.467611 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-a4726483-35bf-4615-9aa0-b3148203b68f tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] [instance: ddf9be16-b3ce-411b-ac14-17dae5f41821] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:44:59.474817 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a4726483-35bf-4615-9aa0-b3148203b68f tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:59.475332 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a4726483-35bf-4615-9aa0-b3148203b68f tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:59.476209 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a4726483-35bf-4615-9aa0-b3148203b68f tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:59.476659 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a4726483-35bf-4615-9aa0-b3148203b68f tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:59.493535 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.wsgi [None req-a4726483-35bf-4615-9aa0-b3148203b68f tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] HTTP exception thrown: Instance ddf9be16-b3ce-411b-ac14-17dae5f41821 could not be found. Aug 01 16:44:59.495197 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-a4726483-35bf-4615-9aa0-b3148203b68f tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Request method failure captured: Aug 01 16:44:59.495197 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: request: GET /compute/v2.1/servers/ddf9be16-b3ce-411b-ac14-17dae5f41821 HTTP/1.1 Aug 01 16:44:59.495197 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Accept: application/json Aug 01 16:44:59.495197 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Accept-Encoding: identity Aug 01 16:44:59.495197 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Connection: close Aug 01 16:44:59.495197 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Content-Length: 0 Aug 01 16:44:59.495197 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Content-Type: application/json Aug 01 16:44:59.495197 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Host: 10.222.0.45 Aug 01 16:44:59.495197 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Openstack-System-Scope: None Aug 01 16:44:59.495197 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: User-Agent: python-urllib3/1.26.10 Aug 01 16:44:59.495197 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Auth-Token: gAAAAABi6AHBHBBMxUjuAe-cwnK815X7ZxuzFHyHjtrk1uJot40PNHiBi2X9YMJeHWohQLbZQ5KLL_REXas2dwpv6zW97hCtQR9_HhjsDDAU83KRBYwvEJCNPLIcHZ71AIrAo_sj1b009gKLC_UwiqB_GoFhYRdPglged0gU-Y7E301TTJaBV1M Aug 01 16:44:59.495197 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Domain-Id: None Aug 01 16:44:59.495197 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Domain-Name: None Aug 01 16:44:59.495197 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Identity-Status: Confirmed Aug 01 16:44:59.495197 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Is-Admin-Project: True Aug 01 16:44:59.495197 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Domain-Id: default Aug 01 16:44:59.495197 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Domain-Name: Default Aug 01 16:44:59.495197 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Id: dbd6814591334db58a37092eb04729fb Aug 01 16:44:59.495197 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1899232052 Aug 01 16:44:59.495197 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Role: reader,member Aug 01 16:44:59.495197 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Roles: reader,member Aug 01 16:44:59.496650 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_dbd6814591334db58a37092eb04729fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/dbd6814591334db58a37092eb04729fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/dbd6814591334db58a37092eb04729fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/dbd6814591334db58a37092eb04729fb"}]}] Aug 01 16:44:59.496650 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1899232052 Aug 01 16:44:59.496650 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant-Id: dbd6814591334db58a37092eb04729fb Aug 01 16:44:59.496650 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1899232052 Aug 01 16:44:59.496650 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User: tempest-ServerRescueNegativeTestJSON-1899232052-project Aug 01 16:44:59.496650 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Domain-Id: default Aug 01 16:44:59.496650 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Domain-Name: Default Aug 01 16:44:59.496650 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Id: 4294d6dff5054da7afcb37b8b28f1a01 Aug 01 16:44:59.496650 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1899232052-project Aug 01 16:44:59.496650 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: method: > Aug 01 16:44:59.496650 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: exception: Instance ddf9be16-b3ce-411b-ac14-17dae5f41821 could not be found. Aug 01 16:44:59.496650 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: action_args: {'id': 'ddf9be16-b3ce-411b-ac14-17dae5f41821'} Aug 01 16:44:59.498553 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:44:59.498553 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:44:59.498553 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 16:44:59.498553 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 16:44:59.498553 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 16:44:59.498553 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 16:44:59.498553 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 16:44:59.498553 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 16:44:59.498553 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 16:44:59.498553 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 16:44:59.498553 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddf9be16-b3ce-411b-ac14-17dae5f41821 could not be found. Aug 01 16:44:59.498553 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:44:59.498553 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:44:59.498553 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:44:59.498553 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:44:59.498553 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:44:59.498553 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:44:59.498553 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:44:59.498553 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:44:59.498553 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:44:59.500168 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:44:59.500168 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 16:44:59.500168 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 16:44:59.500168 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 16:44:59.500168 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 16:44:59.500168 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 16:44:59.500168 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:44:59.500168 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddf9be16-b3ce-411b-ac14-17dae5f41821 could not be found. Aug 01 16:44:59.500168 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:44:59.500168 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:44:59.500168 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:44:59.500168 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:44:59.500168 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:44:59.500168 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:44:59.500168 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:44:59.500168 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:44:59.500168 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddf9be16-b3ce-411b-ac14-17dae5f41821 could not be found. Aug 01 16:44:59.500168 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:44:59.501505 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-a4726483-35bf-4615-9aa0-b3148203b68f tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] Returning 404 to user: Instance ddf9be16-b3ce-411b-ac14-17dae5f41821 could not be found. {{(pid=118118) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:44:59.501505 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-a4726483-35bf-4615-9aa0-b3148203b68f tempest-ServerRescueNegativeTestJSON-1899232052 tempest-ServerRescueNegativeTestJSON-1899232052-project] 10.222.0.45 "GET /compute/v2.1/servers/ddf9be16-b3ce-411b-ac14-17dae5f41821" status: 404 len: 111 microversion: 2.1 time: 0.034312 Aug 01 16:44:59.501505 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 389/768] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:44:59 2022] GET /compute/v2.1/servers/ddf9be16-b3ce-411b-ac14-17dae5f41821 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 16:44:59.857856 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-6d3d651c-baef-45c1-bb11-35390f3f9c4c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:44:59.858799 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-6d3d651c-baef-45c1-bb11-35390f3f9c4c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:44:59.865644 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-6d3d651c-baef-45c1-bb11-35390f3f9c4c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:59.866083 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-6d3d651c-baef-45c1-bb11-35390f3f9c4c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:44:59.866848 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-6d3d651c-baef-45c1-bb11-35390f3f9c4c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:44:59.867305 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-6d3d651c-baef-45c1-bb11-35390f3f9c4c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:00.011558 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-6d3d651c-baef-45c1-bb11-35390f3f9c4c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:00.020328 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-6d3d651c-baef-45c1-bb11-35390f3f9c4c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:00.021970 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-6d3d651c-baef-45c1-bb11-35390f3f9c4c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:00.023351 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-6d3d651c-baef-45c1-bb11-35390f3f9c4c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926" status: 200 len: 1724 microversion: 2.20 time: 0.170345 Aug 01 16:45:00.024062 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 380/769] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:44:59 2022] GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:45:01.049156 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-d3b6b715-4a57-454a-a680-6adaae535a93 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:01.050160 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-d3b6b715-4a57-454a-a680-6adaae535a93 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:01.058436 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-d3b6b715-4a57-454a-a680-6adaae535a93 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:01.058929 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-d3b6b715-4a57-454a-a680-6adaae535a93 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:01.059809 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-d3b6b715-4a57-454a-a680-6adaae535a93 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:01.060319 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-d3b6b715-4a57-454a-a680-6adaae535a93 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:01.266585 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-d3b6b715-4a57-454a-a680-6adaae535a93 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:01.275229 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-d3b6b715-4a57-454a-a680-6adaae535a93 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:01.276756 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-d3b6b715-4a57-454a-a680-6adaae535a93 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:01.277987 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-d3b6b715-4a57-454a-a680-6adaae535a93 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926" status: 200 len: 1724 microversion: 2.20 time: 0.234367 Aug 01 16:45:01.278874 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 390/770] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:45:01 2022] GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926 => generated 1724 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:45:02.302771 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-7d51cfa2-6324-4122-8be8-3881abcb4122 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:02.303381 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-7d51cfa2-6324-4122-8be8-3881abcb4122 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:02.311887 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-7d51cfa2-6324-4122-8be8-3881abcb4122 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:02.312444 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-7d51cfa2-6324-4122-8be8-3881abcb4122 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:02.313244 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-7d51cfa2-6324-4122-8be8-3881abcb4122 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:02.313688 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-7d51cfa2-6324-4122-8be8-3881abcb4122 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:02.469082 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-7d51cfa2-6324-4122-8be8-3881abcb4122 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:02.479074 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-7d51cfa2-6324-4122-8be8-3881abcb4122 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:02.480709 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-7d51cfa2-6324-4122-8be8-3881abcb4122 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:02.481994 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-7d51cfa2-6324-4122-8be8-3881abcb4122 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926" status: 200 len: 1724 microversion: 2.20 time: 0.183610 Aug 01 16:45:02.482545 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 381/771] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:45:02 2022] GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926 => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:45:03.505945 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-c3d2b8ea-4025-4eaa-a7dc-9a41a1b28af7 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:03.506588 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-c3d2b8ea-4025-4eaa-a7dc-9a41a1b28af7 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:03.513756 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-c3d2b8ea-4025-4eaa-a7dc-9a41a1b28af7 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:03.514197 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-c3d2b8ea-4025-4eaa-a7dc-9a41a1b28af7 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:03.515037 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-c3d2b8ea-4025-4eaa-a7dc-9a41a1b28af7 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:03.515467 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-c3d2b8ea-4025-4eaa-a7dc-9a41a1b28af7 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:03.689307 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-c3d2b8ea-4025-4eaa-a7dc-9a41a1b28af7 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:03.698443 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-c3d2b8ea-4025-4eaa-a7dc-9a41a1b28af7 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:03.700514 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-c3d2b8ea-4025-4eaa-a7dc-9a41a1b28af7 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:03.702749 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-c3d2b8ea-4025-4eaa-a7dc-9a41a1b28af7 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926" status: 200 len: 1724 microversion: 2.20 time: 0.201334 Aug 01 16:45:03.704204 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 391/772] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:45:03 2022] GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926 => generated 1724 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:45:04.732084 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-b5136553-fe76-49f8-baeb-f9b059219440 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:04.732757 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-b5136553-fe76-49f8-baeb-f9b059219440 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:04.741281 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-b5136553-fe76-49f8-baeb-f9b059219440 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:04.742016 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-b5136553-fe76-49f8-baeb-f9b059219440 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:04.742913 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-b5136553-fe76-49f8-baeb-f9b059219440 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:04.743406 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-b5136553-fe76-49f8-baeb-f9b059219440 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:04.855361 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-e7c45115-1ca9-4b60-8b35-9b295ffeb868 tempest-VolumesSnapshotsTestJSON-1461023420 tempest-VolumesSnapshotsTestJSON-1461023420-project] Action: 'create', calling method: .version_select at 0x7efd5e988af0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-408638455"}} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:45:04.919939 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-b5136553-fe76-49f8-baeb-f9b059219440 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:04.928413 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-b5136553-fe76-49f8-baeb-f9b059219440 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:04.930205 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-b5136553-fe76-49f8-baeb-f9b059219440 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:04.931501 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-b5136553-fe76-49f8-baeb-f9b059219440 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926" status: 200 len: 1724 microversion: 2.20 time: 0.206230 Aug 01 16:45:04.933417 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 392/773] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:45:04 2022] GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926 => generated 1724 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 16:45:04.937889 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-12322506-63ff-403d-bb19-2620fe5204f4 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:04.940326 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-12322506-63ff-403d-bb19-2620fe5204f4 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: e2e46d25-15d6-4671-8d04-9994875a9f96] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:04.947395 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-12322506-63ff-403d-bb19-2620fe5204f4 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:04.947842 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-12322506-63ff-403d-bb19-2620fe5204f4 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:04.948615 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-12322506-63ff-403d-bb19-2620fe5204f4 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:04.949040 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-12322506-63ff-403d-bb19-2620fe5204f4 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:04.982005 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-12322506-63ff-403d-bb19-2620fe5204f4 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/e2e46d25-15d6-4671-8d04-9994875a9f96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048306 Aug 01 16:45:04.982588 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 393/774] 10.222.0.45 () {58 vars in 1302 bytes} [Mon Aug 1 16:45:04 2022] GET /compute/v2.1/servers/e2e46d25-15d6-4671-8d04-9994875a9f96/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:45:04.993598 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-d79e9cbe-a3fe-48f8-adf2-42c97edb7088 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:04.994093 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-d79e9cbe-a3fe-48f8-adf2-42c97edb7088 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: e2e46d25-15d6-4671-8d04-9994875a9f96] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:05.001300 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-d79e9cbe-a3fe-48f8-adf2-42c97edb7088 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:05.001739 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-d79e9cbe-a3fe-48f8-adf2-42c97edb7088 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:05.002527 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-d79e9cbe-a3fe-48f8-adf2-42c97edb7088 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:05.002949 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-d79e9cbe-a3fe-48f8-adf2-42c97edb7088 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:05.036190 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-d79e9cbe-a3fe-48f8-adf2-42c97edb7088 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/e2e46d25-15d6-4671-8d04-9994875a9f96/os-volume_attachments/ed6e5785-40e9-4f89-9318-b45f3c5733cf" status: 200 len: 194 microversion: 2.1 time: 0.046578 Aug 01 16:45:05.040004 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 394/775] 10.222.0.45 () {58 vars in 1413 bytes} [Mon Aug 1 16:45:04 2022] GET /compute/v2.1/servers/e2e46d25-15d6-4671-8d04-9994875a9f96/os-volume_attachments/ed6e5785-40e9-4f89-9318-b45f3c5733cf => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 16:45:05.253033 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-e7c45115-1ca9-4b60-8b35-9b295ffeb868 tempest-VolumesSnapshotsTestJSON-1461023420 tempest-VolumesSnapshotsTestJSON-1461023420-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.575958 Aug 01 16:45:05.253958 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 382/776] 10.222.0.45 () {60 vars in 1155 bytes} [Mon Aug 1 16:45:04 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 578 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 01 16:45:05.268026 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-637c78e5-b9f0-4cff-94ad-d65045a48008 tempest-VolumesSnapshotsTestJSON-1461023420 tempest-VolumesSnapshotsTestJSON-1461023420-project] Calling method '.version_select at 0x7efd5ed29d30>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:05.335017 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-637c78e5-b9f0-4cff-94ad-d65045a48008 tempest-VolumesSnapshotsTestJSON-1461023420 tempest-VolumesSnapshotsTestJSON-1461023420-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/a97c25b2-5154-465d-bdad-e21e34bab694" status: 200 len: 344 microversion: 2.1 time: 0.071453 Aug 01 16:45:05.335748 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 395/777] 10.222.0.45 () {58 vars in 1245 bytes} [Mon Aug 1 16:45:05 2022] GET /compute/v2.1/os-volumes/a97c25b2-5154-465d-bdad-e21e34bab694 => generated 344 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:45:05.956400 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-18f5af68-acef-45bc-a05d-d642f55ab41d tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:05.957027 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-18f5af68-acef-45bc-a05d-d642f55ab41d tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:05.959035 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=2 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:45:05.968515 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-18f5af68-acef-45bc-a05d-d642f55ab41d tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:05.968941 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-18f5af68-acef-45bc-a05d-d642f55ab41d tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:05.969772 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-18f5af68-acef-45bc-a05d-d642f55ab41d tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:05.970234 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-18f5af68-acef-45bc-a05d-d642f55ab41d tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:06.119981 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-18f5af68-acef-45bc-a05d-d642f55ab41d tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:06.128389 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-18f5af68-acef-45bc-a05d-d642f55ab41d tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:06.129863 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-18f5af68-acef-45bc-a05d-d642f55ab41d tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:06.131029 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-18f5af68-acef-45bc-a05d-d642f55ab41d tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926" status: 200 len: 1724 microversion: 2.20 time: 0.179257 Aug 01 16:45:06.131590 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 383/778] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:45:05 2022] GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926 => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:45:06.350901 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-2b7c3447-126d-486e-a8b5-c372539dac5b tempest-VolumesSnapshotsTestJSON-1461023420 tempest-VolumesSnapshotsTestJSON-1461023420-project] Calling method '.version_select at 0x7efd6749fa60>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:06.404027 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-2b7c3447-126d-486e-a8b5-c372539dac5b tempest-VolumesSnapshotsTestJSON-1461023420 tempest-VolumesSnapshotsTestJSON-1461023420-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/a97c25b2-5154-465d-bdad-e21e34bab694" status: 200 len: 345 microversion: 2.1 time: 0.057450 Aug 01 16:45:06.405266 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 396/779] 10.222.0.45 () {58 vars in 1245 bytes} [Mon Aug 1 16:45:06 2022] GET /compute/v2.1/os-volumes/a97c25b2-5154-465d-bdad-e21e34bab694 => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:45:06.417746 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-a355a47f-6a00-4dab-a98b-b425588bdf92 tempest-VolumesSnapshotsTestJSON-1461023420 tempest-VolumesSnapshotsTestJSON-1461023420-project] Action: 'create', calling method: .version_select at 0x7efd5e988700>, body: {"snapshot": {"volume_id": "a97c25b2-5154-465d-bdad-e21e34bab694", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1541380582"}} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:45:06.470117 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-3c122845-4f42-4a6e-b738-283f27c75f2b tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2e24b2dc-7dbd-47a3-8c70-6e4bde7d1c90"}} {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:45:06.472535 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-3c122845-4f42-4a6e-b738-283f27c75f2b tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: e2e46d25-15d6-4671-8d04-9994875a9f96] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:06.482092 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3c122845-4f42-4a6e-b738-283f27c75f2b tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:06.482525 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3c122845-4f42-4a6e-b738-283f27c75f2b tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:06.483312 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3c122845-4f42-4a6e-b738-283f27c75f2b tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:06.483739 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3c122845-4f42-4a6e-b738-283f27c75f2b tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:06.605000 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-a355a47f-6a00-4dab-a98b-b425588bdf92 tempest-VolumesSnapshotsTestJSON-1461023420 tempest-VolumesSnapshotsTestJSON-1461023420-project] 10.222.0.45 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.191113 Aug 01 16:45:06.605741 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 384/780] 10.222.0.45 () {60 vars in 1162 bytes} [Mon Aug 1 16:45:06 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:45:06.618918 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-e3878d19-005a-40df-ac96-cc82783d2305 tempest-VolumesSnapshotsTestJSON-1461023420 tempest-VolumesSnapshotsTestJSON-1461023420-project] Calling method '.version_select at 0x7efd5e9d9940>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:06.652880 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-e3878d19-005a-40df-ac96-cc82783d2305 tempest-VolumesSnapshotsTestJSON-1461023420 tempest-VolumesSnapshotsTestJSON-1461023420-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/6f062da6-484c-4017-8b1f-f768d86713e6" status: 200 len: 287 microversion: 2.1 time: 0.039917 Aug 01 16:45:06.653677 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 385/781] 10.222.0.45 () {58 vars in 1251 bytes} [Mon Aug 1 16:45:06 2022] GET /compute/v2.1/os-snapshots/6f062da6-484c-4017-8b1f-f768d86713e6 => generated 287 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:45:06.665027 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-36da164d-6630-4c23-bcce-eee9051f5b0f tempest-VolumesSnapshotsTestJSON-1461023420 tempest-VolumesSnapshotsTestJSON-1461023420-project] Calling method '.version_select at 0x7efd5ea2bca0>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:06.700044 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-36da164d-6630-4c23-bcce-eee9051f5b0f tempest-VolumesSnapshotsTestJSON-1461023420 tempest-VolumesSnapshotsTestJSON-1461023420-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.039117 Aug 01 16:45:06.700811 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 386/782] 10.222.0.45 () {58 vars in 1140 bytes} [Mon Aug 1 16:45:06 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 16:45:06.712783 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-5bcc45cd-5078-460d-9ac8-9a82d5c7d020 tempest-VolumesSnapshotsTestJSON-1461023420 tempest-VolumesSnapshotsTestJSON-1461023420-project] Calling method '.version_select at 0x7efd5e9ddb80>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:06.746677 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-5bcc45cd-5078-460d-9ac8-9a82d5c7d020 tempest-VolumesSnapshotsTestJSON-1461023420 tempest-VolumesSnapshotsTestJSON-1461023420-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/6f062da6-484c-4017-8b1f-f768d86713e6" status: 200 len: 287 microversion: 2.1 time: 0.038198 Aug 01 16:45:06.747199 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 387/783] 10.222.0.45 () {58 vars in 1251 bytes} [Mon Aug 1 16:45:06 2022] GET /compute/v2.1/os-snapshots/6f062da6-484c-4017-8b1f-f768d86713e6 => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 16:45:06.772109 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-3c122845-4f42-4a6e-b738-283f27c75f2b tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "POST /compute/v2.1/servers/e2e46d25-15d6-4671-8d04-9994875a9f96/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.305704 Aug 01 16:45:06.775848 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 397/784] 10.222.0.45 () {60 vars in 1323 bytes} [Mon Aug 1 16:45:06 2022] POST /compute/v2.1/servers/e2e46d25-15d6-4671-8d04-9994875a9f96/os-volume_attachments => generated 194 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 16:45:07.155135 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-0764d6b9-9706-4dce-bb9d-2fc253a576ca tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:07.155694 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-0764d6b9-9706-4dce-bb9d-2fc253a576ca tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:07.162213 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-0764d6b9-9706-4dce-bb9d-2fc253a576ca tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:07.162663 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-0764d6b9-9706-4dce-bb9d-2fc253a576ca tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:07.163407 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-0764d6b9-9706-4dce-bb9d-2fc253a576ca tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:07.164113 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-0764d6b9-9706-4dce-bb9d-2fc253a576ca tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:07.298344 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-0764d6b9-9706-4dce-bb9d-2fc253a576ca tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:07.307226 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-0764d6b9-9706-4dce-bb9d-2fc253a576ca tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:07.308749 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-0764d6b9-9706-4dce-bb9d-2fc253a576ca tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:07.309990 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-0764d6b9-9706-4dce-bb9d-2fc253a576ca tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926" status: 200 len: 1724 microversion: 2.20 time: 0.159560 Aug 01 16:45:07.310549 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 388/785] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:45:07 2022] GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:45:07.760500 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-b2a33f63-025f-41ef-bb42-16bc236c5941 tempest-VolumesSnapshotsTestJSON-1461023420 tempest-VolumesSnapshotsTestJSON-1461023420-project] Calling method '.version_select at 0x7efd674f38b0>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:07.793880 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-b2a33f63-025f-41ef-bb42-16bc236c5941 tempest-VolumesSnapshotsTestJSON-1461023420 tempest-VolumesSnapshotsTestJSON-1461023420-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/6f062da6-484c-4017-8b1f-f768d86713e6" status: 200 len: 287 microversion: 2.1 time: 0.037724 Aug 01 16:45:07.794563 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 398/786] 10.222.0.45 () {58 vars in 1251 bytes} [Mon Aug 1 16:45:07 2022] GET /compute/v2.1/os-snapshots/6f062da6-484c-4017-8b1f-f768d86713e6 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:45:08.334235 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-f84a40b3-5e5c-4522-837c-cb3301343853 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:08.334837 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-f84a40b3-5e5c-4522-837c-cb3301343853 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:08.341902 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-f84a40b3-5e5c-4522-837c-cb3301343853 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:08.342341 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-f84a40b3-5e5c-4522-837c-cb3301343853 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:08.343203 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-f84a40b3-5e5c-4522-837c-cb3301343853 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:08.343516 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-f84a40b3-5e5c-4522-837c-cb3301343853 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:08.489075 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-f84a40b3-5e5c-4522-837c-cb3301343853 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:08.491348 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:45:08.498920 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-f84a40b3-5e5c-4522-837c-cb3301343853 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:08.500465 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-f84a40b3-5e5c-4522-837c-cb3301343853 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:08.501649 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-f84a40b3-5e5c-4522-837c-cb3301343853 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926" status: 200 len: 1724 microversion: 2.20 time: 0.172054 Aug 01 16:45:08.502205 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 389/787] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:45:08 2022] GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:45:08.807613 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-100e069a-ac41-42bd-9398-4ff714138892 tempest-VolumesSnapshotsTestJSON-1461023420 tempest-VolumesSnapshotsTestJSON-1461023420-project] Calling method '.version_select at 0x7efd6749fd30>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:08.838266 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-100e069a-ac41-42bd-9398-4ff714138892 tempest-VolumesSnapshotsTestJSON-1461023420 tempest-VolumesSnapshotsTestJSON-1461023420-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/6f062da6-484c-4017-8b1f-f768d86713e6" status: 200 len: 287 microversion: 2.1 time: 0.035253 Aug 01 16:45:08.838846 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 399/788] 10.222.0.45 () {58 vars in 1251 bytes} [Mon Aug 1 16:45:08 2022] GET /compute/v2.1/os-snapshots/6f062da6-484c-4017-8b1f-f768d86713e6 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:45:09.526567 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-45dcea77-f8b9-4fd4-a47c-636425343e6f tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:09.527190 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-45dcea77-f8b9-4fd4-a47c-636425343e6f tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:09.535567 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-45dcea77-f8b9-4fd4-a47c-636425343e6f tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:09.535930 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-45dcea77-f8b9-4fd4-a47c-636425343e6f tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:09.536963 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-45dcea77-f8b9-4fd4-a47c-636425343e6f tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:09.537805 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-45dcea77-f8b9-4fd4-a47c-636425343e6f tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:09.690143 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-45dcea77-f8b9-4fd4-a47c-636425343e6f tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:09.700113 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-45dcea77-f8b9-4fd4-a47c-636425343e6f tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:09.701655 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-45dcea77-f8b9-4fd4-a47c-636425343e6f tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:09.702838 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-45dcea77-f8b9-4fd4-a47c-636425343e6f tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926" status: 200 len: 1724 microversion: 2.20 time: 0.181491 Aug 01 16:45:09.703398 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 390/789] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:45:09 2022] GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926 => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:45:09.857222 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-b1d9ca54-1df5-43c1-a80f-5c6ea4a29832 tempest-VolumesSnapshotsTestJSON-1461023420 tempest-VolumesSnapshotsTestJSON-1461023420-project] Calling method '.version_select at 0x7efd674f43a0>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:09.904635 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-b1d9ca54-1df5-43c1-a80f-5c6ea4a29832 tempest-VolumesSnapshotsTestJSON-1461023420 tempest-VolumesSnapshotsTestJSON-1461023420-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/6f062da6-484c-4017-8b1f-f768d86713e6" status: 200 len: 288 microversion: 2.1 time: 0.055832 Aug 01 16:45:09.905286 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 400/790] 10.222.0.45 () {58 vars in 1251 bytes} [Mon Aug 1 16:45:09 2022] GET /compute/v2.1/os-snapshots/6f062da6-484c-4017-8b1f-f768d86713e6 => generated 288 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:45:09.917813 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-19c07bd3-954d-4b31-834b-faa8c313b492 tempest-VolumesSnapshotsTestJSON-1461023420 tempest-VolumesSnapshotsTestJSON-1461023420-project] Calling method '.version_select at 0x7efd5ea8b1f0>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:09.988702 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-19c07bd3-954d-4b31-834b-faa8c313b492 tempest-VolumesSnapshotsTestJSON-1461023420 tempest-VolumesSnapshotsTestJSON-1461023420-project] 10.222.0.45 "DELETE /compute/v2.1/os-snapshots/6f062da6-484c-4017-8b1f-f768d86713e6" status: 202 len: 0 microversion: 2.1 time: 0.075190 Aug 01 16:45:09.989283 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 391/791] 10.222.0.45 () {58 vars in 1254 bytes} [Mon Aug 1 16:45:09 2022] DELETE /compute/v2.1/os-snapshots/6f062da6-484c-4017-8b1f-f768d86713e6 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 16:45:10.004768 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-ff368f26-2420-412f-a122-21133de5ca34 tempest-VolumesSnapshotsTestJSON-1461023420 tempest-VolumesSnapshotsTestJSON-1461023420-project] Calling method '.version_select at 0x7efd674f4dc0>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:10.037691 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-ff368f26-2420-412f-a122-21133de5ca34 tempest-VolumesSnapshotsTestJSON-1461023420 tempest-VolumesSnapshotsTestJSON-1461023420-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/6f062da6-484c-4017-8b1f-f768d86713e6" status: 200 len: 287 microversion: 2.1 time: 0.039965 Aug 01 16:45:10.038281 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 401/792] 10.222.0.45 () {58 vars in 1251 bytes} [Mon Aug 1 16:45:09 2022] GET /compute/v2.1/os-snapshots/6f062da6-484c-4017-8b1f-f768d86713e6 => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:45:10.727257 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-d1cf9084-90a9-4a9d-8aa1-58b506d235ff tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:10.727900 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-d1cf9084-90a9-4a9d-8aa1-58b506d235ff tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:10.734653 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-d1cf9084-90a9-4a9d-8aa1-58b506d235ff tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:10.735103 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-d1cf9084-90a9-4a9d-8aa1-58b506d235ff tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:10.735922 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-d1cf9084-90a9-4a9d-8aa1-58b506d235ff tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:10.736357 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-d1cf9084-90a9-4a9d-8aa1-58b506d235ff tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:10.884225 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-d1cf9084-90a9-4a9d-8aa1-58b506d235ff tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:10.892675 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-d1cf9084-90a9-4a9d-8aa1-58b506d235ff tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:10.894158 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-d1cf9084-90a9-4a9d-8aa1-58b506d235ff tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:10.895351 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-d1cf9084-90a9-4a9d-8aa1-58b506d235ff tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926" status: 200 len: 1724 microversion: 2.20 time: 0.172699 Aug 01 16:45:10.895995 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 392/793] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:45:10 2022] GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:45:11.051463 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-92850434-cd90-4f59-af6c-e53c759daabc tempest-VolumesSnapshotsTestJSON-1461023420 tempest-VolumesSnapshotsTestJSON-1461023420-project] Calling method '.version_select at 0x7efd6747c430>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:11.078094 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.wsgi [None req-92850434-cd90-4f59-af6c-e53c759daabc tempest-VolumesSnapshotsTestJSON-1461023420 tempest-VolumesSnapshotsTestJSON-1461023420-project] HTTP exception thrown: Snapshot 6f062da6-484c-4017-8b1f-f768d86713e6 could not be found. Aug 01 16:45:11.080502 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-92850434-cd90-4f59-af6c-e53c759daabc tempest-VolumesSnapshotsTestJSON-1461023420 tempest-VolumesSnapshotsTestJSON-1461023420-project] Request method failure captured: Aug 01 16:45:11.080502 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: request: GET /compute/v2.1/os-snapshots/6f062da6-484c-4017-8b1f-f768d86713e6 HTTP/1.1 Aug 01 16:45:11.080502 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Accept: application/json Aug 01 16:45:11.080502 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Accept-Encoding: identity Aug 01 16:45:11.080502 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Connection: close Aug 01 16:45:11.080502 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Content-Length: 0 Aug 01 16:45:11.080502 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Content-Type: application/json Aug 01 16:45:11.080502 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Host: 10.222.0.45 Aug 01 16:45:11.080502 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Openstack-System-Scope: None Aug 01 16:45:11.080502 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: User-Agent: python-urllib3/1.26.10 Aug 01 16:45:11.080502 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Auth-Token: gAAAAABi6AMQ_WscaDoUkNb-YF1bxwVr1wxifMD1rcW3SVGIFZyhASY5Fkllb_SgQ4YLwKq83TZJZ9jwtC6KHXv9n3uh_nx-FOSqK0nDgP8JhcVZ43rcOIiqt0HllhA8uQaYmqFEwLM9dy7kOvD2VjdQmv9kq9UMXZw9kHqNV2LcWnfCC__av4w Aug 01 16:45:11.080502 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Domain-Id: None Aug 01 16:45:11.080502 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Domain-Name: None Aug 01 16:45:11.080502 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Identity-Status: Confirmed Aug 01 16:45:11.080502 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Is-Admin-Project: True Aug 01 16:45:11.080502 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Domain-Id: default Aug 01 16:45:11.080502 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Domain-Name: Default Aug 01 16:45:11.080502 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Id: c3601a4f15d84ea6b32e39f5e5a0f462 Aug 01 16:45:11.080502 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1461023420 Aug 01 16:45:11.080502 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Role: reader,member Aug 01 16:45:11.080502 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Roles: reader,member Aug 01 16:45:11.081966 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c3601a4f15d84ea6b32e39f5e5a0f462"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c3601a4f15d84ea6b32e39f5e5a0f462"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c3601a4f15d84ea6b32e39f5e5a0f462"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c3601a4f15d84ea6b32e39f5e5a0f462"}]}] Aug 01 16:45:11.081966 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1461023420 Aug 01 16:45:11.081966 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant-Id: c3601a4f15d84ea6b32e39f5e5a0f462 Aug 01 16:45:11.081966 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1461023420 Aug 01 16:45:11.081966 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User: tempest-VolumesSnapshotsTestJSON-1461023420-project Aug 01 16:45:11.081966 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Domain-Id: default Aug 01 16:45:11.081966 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Domain-Name: Default Aug 01 16:45:11.081966 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Id: 63a00b55295240d3a8b36a8cc156f667 Aug 01 16:45:11.081966 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1461023420-project Aug 01 16:45:11.081966 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: method: Aug 01 16:45:11.081966 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: exception: Snapshot 6f062da6-484c-4017-8b1f-f768d86713e6 could not be found. Aug 01 16:45:11.081966 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: action_args: {'id': '6f062da6-484c-4017-8b1f-f768d86713e6'} Aug 01 16:45:11.081966 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:45:11.083060 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:45:11.083060 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 01 16:45:11.083060 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 01 16:45:11.083060 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 01 16:45:11.083060 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 01 16:45:11.083060 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 01 16:45:11.083060 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 01 16:45:11.083060 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 16:45:11.083060 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 16:45:11.083060 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 16:45:11.083060 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 16:45:11.083060 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 16:45:11.083060 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 16:45:11.083060 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 16:45:11.083060 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 16:45:11.083060 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 6f062da6-484c-4017-8b1f-f768d86713e6 could not be found. (HTTP 404) (Request-ID: req-8a3e51a6-bb6a-4e2c-9c1b-0f4adee21124) Aug 01 16:45:11.083060 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:45:11.083060 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:45:11.084273 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:45:11.084273 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:45:11.084273 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 01 16:45:11.084273 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 01 16:45:11.084273 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 16:45:11.084273 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 16:45:11.084273 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 01 16:45:11.084273 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 01 16:45:11.084273 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 16:45:11.084273 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 16:45:11.084273 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 01 16:45:11.084273 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 01 16:45:11.084273 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 01 16:45:11.084273 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 01 16:45:11.084273 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 01 16:45:11.084273 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 01 16:45:11.084273 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 16:45:11.084273 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 16:45:11.084273 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 16:45:11.085415 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 16:45:11.085415 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 16:45:11.085415 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 16:45:11.085415 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 16:45:11.085415 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 16:45:11.085415 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 6f062da6-484c-4017-8b1f-f768d86713e6 could not be found. Aug 01 16:45:11.085415 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:45:11.085415 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:45:11.085415 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:45:11.085415 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:45:11.085415 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:45:11.085415 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:45:11.085415 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:45:11.085415 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:45:11.085415 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 16:45:11.085415 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 16:45:11.085415 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:45:11.085415 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:45:11.085415 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 01 16:45:11.085415 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:45:11.086613 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 6f062da6-484c-4017-8b1f-f768d86713e6 could not be found. Aug 01 16:45:11.086613 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:45:11.086613 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:45:11.086613 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:45:11.086613 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:45:11.086613 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:45:11.086613 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:45:11.086613 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:45:11.086613 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:45:11.086613 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 6f062da6-484c-4017-8b1f-f768d86713e6 could not be found. Aug 01 16:45:11.086613 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:45:11.086613 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-92850434-cd90-4f59-af6c-e53c759daabc tempest-VolumesSnapshotsTestJSON-1461023420 tempest-VolumesSnapshotsTestJSON-1461023420-project] Returning 404 to user: Snapshot 6f062da6-484c-4017-8b1f-f768d86713e6 could not be found. {{(pid=118118) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:45:11.086613 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-92850434-cd90-4f59-af6c-e53c759daabc tempest-VolumesSnapshotsTestJSON-1461023420 tempest-VolumesSnapshotsTestJSON-1461023420-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/6f062da6-484c-4017-8b1f-f768d86713e6" status: 404 len: 111 microversion: 2.1 time: 0.034807 Aug 01 16:45:11.087413 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 402/794] 10.222.0.45 () {58 vars in 1251 bytes} [Mon Aug 1 16:45:11 2022] GET /compute/v2.1/os-snapshots/6f062da6-484c-4017-8b1f-f768d86713e6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 16:45:11.093167 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-227a5759-5bee-41f9-817c-7407abdae1f1 tempest-VolumesSnapshotsTestJSON-1461023420 tempest-VolumesSnapshotsTestJSON-1461023420-project] Calling method '.version_select at 0x7efd5ea8b1f0>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:11.163506 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-227a5759-5bee-41f9-817c-7407abdae1f1 tempest-VolumesSnapshotsTestJSON-1461023420 tempest-VolumesSnapshotsTestJSON-1461023420-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/a97c25b2-5154-465d-bdad-e21e34bab694" status: 202 len: 0 microversion: 2.1 time: 0.074711 Aug 01 16:45:11.165534 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 393/795] 10.222.0.45 () {58 vars in 1248 bytes} [Mon Aug 1 16:45:11 2022] DELETE /compute/v2.1/os-volumes/a97c25b2-5154-465d-bdad-e21e34bab694 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 16:45:11.174720 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-bd78248b-dcd0-4520-83ac-6f2ae9c7a01a tempest-VolumesSnapshotsTestJSON-1461023420 tempest-VolumesSnapshotsTestJSON-1461023420-project] Calling method '.version_select at 0x7efd674888b0>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:11.230328 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-bd78248b-dcd0-4520-83ac-6f2ae9c7a01a tempest-VolumesSnapshotsTestJSON-1461023420 tempest-VolumesSnapshotsTestJSON-1461023420-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/a97c25b2-5154-465d-bdad-e21e34bab694" status: 200 len: 344 microversion: 2.1 time: 0.060085 Aug 01 16:45:11.231142 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 403/796] 10.222.0.45 () {58 vars in 1245 bytes} [Mon Aug 1 16:45:11 2022] GET /compute/v2.1/os-volumes/a97c25b2-5154-465d-bdad-e21e34bab694 => generated 344 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:45:11.921390 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-f43ffc02-f6e9-4e17-a9d5-3680c32767cd tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:11.922007 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-f43ffc02-f6e9-4e17-a9d5-3680c32767cd tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:11.928933 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-f43ffc02-f6e9-4e17-a9d5-3680c32767cd tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:11.930347 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-f43ffc02-f6e9-4e17-a9d5-3680c32767cd tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:11.931104 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-f43ffc02-f6e9-4e17-a9d5-3680c32767cd tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:11.931517 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-f43ffc02-f6e9-4e17-a9d5-3680c32767cd tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:12.086923 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-f43ffc02-f6e9-4e17-a9d5-3680c32767cd tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:12.095980 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-f43ffc02-f6e9-4e17-a9d5-3680c32767cd tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:12.097534 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-f43ffc02-f6e9-4e17-a9d5-3680c32767cd tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:12.098733 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-f43ffc02-f6e9-4e17-a9d5-3680c32767cd tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926" status: 200 len: 1724 microversion: 2.20 time: 0.181840 Aug 01 16:45:12.099323 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 394/797] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:45:11 2022] GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926 => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:45:12.246438 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-1249790c-60f1-439e-8bc2-cdfc83e0dd8b tempest-VolumesSnapshotsTestJSON-1461023420 tempest-VolumesSnapshotsTestJSON-1461023420-project] Calling method '.version_select at 0x7efd674f3940>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:12.277319 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.wsgi [None req-1249790c-60f1-439e-8bc2-cdfc83e0dd8b tempest-VolumesSnapshotsTestJSON-1461023420 tempest-VolumesSnapshotsTestJSON-1461023420-project] HTTP exception thrown: Volume a97c25b2-5154-465d-bdad-e21e34bab694 could not be found. Aug 01 16:45:12.279293 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-1249790c-60f1-439e-8bc2-cdfc83e0dd8b tempest-VolumesSnapshotsTestJSON-1461023420 tempest-VolumesSnapshotsTestJSON-1461023420-project] Request method failure captured: Aug 01 16:45:12.279293 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: request: GET /compute/v2.1/os-volumes/a97c25b2-5154-465d-bdad-e21e34bab694 HTTP/1.1 Aug 01 16:45:12.279293 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Accept: application/json Aug 01 16:45:12.279293 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Accept-Encoding: identity Aug 01 16:45:12.279293 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Connection: close Aug 01 16:45:12.279293 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Content-Length: 0 Aug 01 16:45:12.279293 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Content-Type: application/json Aug 01 16:45:12.279293 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Host: 10.222.0.45 Aug 01 16:45:12.279293 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Openstack-System-Scope: None Aug 01 16:45:12.279293 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: User-Agent: python-urllib3/1.26.10 Aug 01 16:45:12.279293 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Auth-Token: gAAAAABi6AMQ_WscaDoUkNb-YF1bxwVr1wxifMD1rcW3SVGIFZyhASY5Fkllb_SgQ4YLwKq83TZJZ9jwtC6KHXv9n3uh_nx-FOSqK0nDgP8JhcVZ43rcOIiqt0HllhA8uQaYmqFEwLM9dy7kOvD2VjdQmv9kq9UMXZw9kHqNV2LcWnfCC__av4w Aug 01 16:45:12.279293 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Domain-Id: None Aug 01 16:45:12.279293 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Domain-Name: None Aug 01 16:45:12.279293 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Identity-Status: Confirmed Aug 01 16:45:12.279293 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Is-Admin-Project: True Aug 01 16:45:12.279293 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Domain-Id: default Aug 01 16:45:12.279293 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Domain-Name: Default Aug 01 16:45:12.279293 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Id: c3601a4f15d84ea6b32e39f5e5a0f462 Aug 01 16:45:12.279293 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1461023420 Aug 01 16:45:12.279293 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Role: reader,member Aug 01 16:45:12.279293 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Roles: reader,member Aug 01 16:45:12.281618 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c3601a4f15d84ea6b32e39f5e5a0f462"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c3601a4f15d84ea6b32e39f5e5a0f462"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c3601a4f15d84ea6b32e39f5e5a0f462"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c3601a4f15d84ea6b32e39f5e5a0f462"}]}] Aug 01 16:45:12.281618 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1461023420 Aug 01 16:45:12.281618 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant-Id: c3601a4f15d84ea6b32e39f5e5a0f462 Aug 01 16:45:12.281618 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1461023420 Aug 01 16:45:12.281618 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User: tempest-VolumesSnapshotsTestJSON-1461023420-project Aug 01 16:45:12.281618 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Domain-Id: default Aug 01 16:45:12.281618 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Domain-Name: Default Aug 01 16:45:12.281618 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Id: 63a00b55295240d3a8b36a8cc156f667 Aug 01 16:45:12.281618 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1461023420-project Aug 01 16:45:12.281618 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: method: Aug 01 16:45:12.281618 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: exception: Volume a97c25b2-5154-465d-bdad-e21e34bab694 could not be found. Aug 01 16:45:12.281618 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: action_args: {'id': 'a97c25b2-5154-465d-bdad-e21e34bab694'} Aug 01 16:45:12.281618 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:45:12.282940 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:45:12.282940 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 16:45:12.282940 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 16:45:12.282940 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 16:45:12.282940 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 16:45:12.282940 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 16:45:12.282940 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 16:45:12.282940 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 16:45:12.282940 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 16:45:12.282940 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 16:45:12.282940 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 16:45:12.282940 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 16:45:12.282940 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 16:45:12.282940 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 16:45:12.282940 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 16:45:12.282940 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a97c25b2-5154-465d-bdad-e21e34bab694 could not be found. (HTTP 404) (Request-ID: req-8e167919-723a-4ab1-a975-ec5edfe14251) Aug 01 16:45:12.282940 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:45:12.282940 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:45:12.282940 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:45:12.284730 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:45:12.284730 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 01 16:45:12.284730 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 01 16:45:12.284730 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 16:45:12.284730 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 16:45:12.284730 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 16:45:12.284730 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 16:45:12.284730 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 16:45:12.284730 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 16:45:12.284730 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 16:45:12.284730 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 16:45:12.284730 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 16:45:12.284730 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 16:45:12.284730 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 16:45:12.284730 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 16:45:12.284730 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 16:45:12.284730 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 16:45:12.284730 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 16:45:12.284730 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 16:45:12.286668 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 16:45:12.286668 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 16:45:12.286668 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 16:45:12.286668 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 16:45:12.286668 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a97c25b2-5154-465d-bdad-e21e34bab694 could not be found. Aug 01 16:45:12.286668 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:45:12.286668 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:45:12.286668 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:45:12.286668 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:45:12.286668 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:45:12.286668 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:45:12.286668 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:45:12.286668 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:45:12.286668 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 16:45:12.286668 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 16:45:12.286668 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:45:12.286668 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:45:12.286668 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 01 16:45:12.286668 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:45:12.288810 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a97c25b2-5154-465d-bdad-e21e34bab694 could not be found. Aug 01 16:45:12.288810 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:45:12.288810 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:45:12.288810 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:45:12.288810 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:45:12.288810 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:45:12.288810 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:45:12.288810 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:45:12.288810 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:45:12.288810 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a97c25b2-5154-465d-bdad-e21e34bab694 could not be found. Aug 01 16:45:12.288810 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:45:12.288810 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-1249790c-60f1-439e-8bc2-cdfc83e0dd8b tempest-VolumesSnapshotsTestJSON-1461023420 tempest-VolumesSnapshotsTestJSON-1461023420-project] Returning 404 to user: Volume a97c25b2-5154-465d-bdad-e21e34bab694 could not be found. {{(pid=118118) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:45:12.288810 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-1249790c-60f1-439e-8bc2-cdfc83e0dd8b tempest-VolumesSnapshotsTestJSON-1461023420 tempest-VolumesSnapshotsTestJSON-1461023420-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/a97c25b2-5154-465d-bdad-e21e34bab694" status: 404 len: 109 microversion: 2.1 time: 0.039120 Aug 01 16:45:12.288810 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 404/798] 10.222.0.45 () {58 vars in 1245 bytes} [Mon Aug 1 16:45:12 2022] GET /compute/v2.1/os-volumes/a97c25b2-5154-465d-bdad-e21e34bab694 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 16:45:12.291450 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-f550880c-44d0-48a9-aa17-cde0dcf15ff1 tempest-VolumesSnapshotsTestJSON-1461023420 tempest-VolumesSnapshotsTestJSON-1461023420-project] Calling method '.version_select at 0x7efd5eda3670>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:12.321606 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.wsgi [None req-f550880c-44d0-48a9-aa17-cde0dcf15ff1 tempest-VolumesSnapshotsTestJSON-1461023420 tempest-VolumesSnapshotsTestJSON-1461023420-project] HTTP exception thrown: Volume a97c25b2-5154-465d-bdad-e21e34bab694 could not be found. Aug 01 16:45:12.323782 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-f550880c-44d0-48a9-aa17-cde0dcf15ff1 tempest-VolumesSnapshotsTestJSON-1461023420 tempest-VolumesSnapshotsTestJSON-1461023420-project] Request method failure captured: Aug 01 16:45:12.323782 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: request: DELETE /compute/v2.1/os-volumes/a97c25b2-5154-465d-bdad-e21e34bab694 HTTP/1.1 Aug 01 16:45:12.323782 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Accept: application/json Aug 01 16:45:12.323782 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Accept-Encoding: identity Aug 01 16:45:12.323782 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Connection: close Aug 01 16:45:12.323782 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Content-Length: 0 Aug 01 16:45:12.323782 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Content-Type: application/json Aug 01 16:45:12.323782 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Host: 10.222.0.45 Aug 01 16:45:12.323782 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Openstack-System-Scope: None Aug 01 16:45:12.323782 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: User-Agent: python-urllib3/1.26.10 Aug 01 16:45:12.323782 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Auth-Token: gAAAAABi6AMQ_WscaDoUkNb-YF1bxwVr1wxifMD1rcW3SVGIFZyhASY5Fkllb_SgQ4YLwKq83TZJZ9jwtC6KHXv9n3uh_nx-FOSqK0nDgP8JhcVZ43rcOIiqt0HllhA8uQaYmqFEwLM9dy7kOvD2VjdQmv9kq9UMXZw9kHqNV2LcWnfCC__av4w Aug 01 16:45:12.323782 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Domain-Id: None Aug 01 16:45:12.323782 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Domain-Name: None Aug 01 16:45:12.323782 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Identity-Status: Confirmed Aug 01 16:45:12.323782 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Is-Admin-Project: True Aug 01 16:45:12.323782 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Domain-Id: default Aug 01 16:45:12.323782 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Domain-Name: Default Aug 01 16:45:12.323782 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Id: c3601a4f15d84ea6b32e39f5e5a0f462 Aug 01 16:45:12.323782 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1461023420 Aug 01 16:45:12.323782 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Role: reader,member Aug 01 16:45:12.323782 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Roles: reader,member Aug 01 16:45:12.325248 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c3601a4f15d84ea6b32e39f5e5a0f462"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c3601a4f15d84ea6b32e39f5e5a0f462"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c3601a4f15d84ea6b32e39f5e5a0f462"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c3601a4f15d84ea6b32e39f5e5a0f462"}]}] Aug 01 16:45:12.325248 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1461023420 Aug 01 16:45:12.325248 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Tenant-Id: c3601a4f15d84ea6b32e39f5e5a0f462 Aug 01 16:45:12.325248 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1461023420 Aug 01 16:45:12.325248 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User: tempest-VolumesSnapshotsTestJSON-1461023420-project Aug 01 16:45:12.325248 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Domain-Id: default Aug 01 16:45:12.325248 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Domain-Name: Default Aug 01 16:45:12.325248 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Id: 63a00b55295240d3a8b36a8cc156f667 Aug 01 16:45:12.325248 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1461023420-project Aug 01 16:45:12.325248 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: method: Aug 01 16:45:12.325248 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: exception: Volume a97c25b2-5154-465d-bdad-e21e34bab694 could not be found. Aug 01 16:45:12.325248 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: action_args: {'id': 'a97c25b2-5154-465d-bdad-e21e34bab694'} Aug 01 16:45:12.325248 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:45:12.326094 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:45:12.326094 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 16:45:12.326094 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 16:45:12.326094 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 01 16:45:12.326094 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 01 16:45:12.326094 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 01 16:45:12.326094 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 01 16:45:12.326094 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 01 16:45:12.326094 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 01 16:45:12.326094 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 01 16:45:12.326094 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 01 16:45:12.326094 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 16:45:12.326094 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 16:45:12.326094 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 16:45:12.326094 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 16:45:12.326094 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a97c25b2-5154-465d-bdad-e21e34bab694 could not be found. (HTTP 404) (Request-ID: req-f4f11a69-c92c-4e41-bd69-0cffd9fc08fc) Aug 01 16:45:12.326094 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:45:12.326094 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:45:12.326094 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:45:12.327233 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:45:12.327233 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 01 16:45:12.327233 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 01 16:45:12.327233 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 16:45:12.327233 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 16:45:12.327233 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 16:45:12.327233 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 16:45:12.327233 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 16:45:12.327233 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 16:45:12.327233 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 16:45:12.327233 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 16:45:12.327233 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 01 16:45:12.327233 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 01 16:45:12.327233 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 01 16:45:12.327233 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 01 16:45:12.327233 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 01 16:45:12.327233 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 01 16:45:12.327233 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 01 16:45:12.327233 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 01 16:45:12.328359 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 16:45:12.328359 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 16:45:12.328359 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 16:45:12.328359 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 16:45:12.328359 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a97c25b2-5154-465d-bdad-e21e34bab694 could not be found. Aug 01 16:45:12.328359 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:45:12.328359 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:45:12.328359 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:45:12.328359 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:45:12.328359 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:45:12.328359 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:45:12.328359 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:45:12.328359 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:45:12.328359 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 16:45:12.328359 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 16:45:12.328359 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:45:12.328359 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:45:12.328359 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 01 16:45:12.328359 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:45:12.329463 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a97c25b2-5154-465d-bdad-e21e34bab694 could not be found. Aug 01 16:45:12.329463 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:45:12.329463 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:45:12.329463 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:45:12.329463 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:45:12.329463 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:45:12.329463 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:45:12.329463 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:45:12.329463 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:45:12.329463 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a97c25b2-5154-465d-bdad-e21e34bab694 could not be found. Aug 01 16:45:12.329463 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:45:12.329463 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-f550880c-44d0-48a9-aa17-cde0dcf15ff1 tempest-VolumesSnapshotsTestJSON-1461023420 tempest-VolumesSnapshotsTestJSON-1461023420-project] Returning 404 to user: Volume a97c25b2-5154-465d-bdad-e21e34bab694 could not be found. {{(pid=118117) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:45:12.329463 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-f550880c-44d0-48a9-aa17-cde0dcf15ff1 tempest-VolumesSnapshotsTestJSON-1461023420 tempest-VolumesSnapshotsTestJSON-1461023420-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/a97c25b2-5154-465d-bdad-e21e34bab694" status: 404 len: 109 microversion: 2.1 time: 0.038009 Aug 01 16:45:12.329463 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 395/799] 10.222.0.45 () {58 vars in 1248 bytes} [Mon Aug 1 16:45:12 2022] DELETE /compute/v2.1/os-volumes/a97c25b2-5154-465d-bdad-e21e34bab694 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 16:45:12.333980 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-3046cba3-096c-44b9-9831-e8610e57c819 tempest-VolumesSnapshotsTestJSON-1461023420 tempest-VolumesSnapshotsTestJSON-1461023420-project] Calling method '.version_select at 0x7efd5ed17c10>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:12.363332 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.wsgi [None req-3046cba3-096c-44b9-9831-e8610e57c819 tempest-VolumesSnapshotsTestJSON-1461023420 tempest-VolumesSnapshotsTestJSON-1461023420-project] HTTP exception thrown: Volume a97c25b2-5154-465d-bdad-e21e34bab694 could not be found. Aug 01 16:45:12.365302 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-3046cba3-096c-44b9-9831-e8610e57c819 tempest-VolumesSnapshotsTestJSON-1461023420 tempest-VolumesSnapshotsTestJSON-1461023420-project] Request method failure captured: Aug 01 16:45:12.365302 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: request: GET /compute/v2.1/os-volumes/a97c25b2-5154-465d-bdad-e21e34bab694 HTTP/1.1 Aug 01 16:45:12.365302 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Accept: application/json Aug 01 16:45:12.365302 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Accept-Encoding: identity Aug 01 16:45:12.365302 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Connection: close Aug 01 16:45:12.365302 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Content-Length: 0 Aug 01 16:45:12.365302 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Content-Type: application/json Aug 01 16:45:12.365302 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Host: 10.222.0.45 Aug 01 16:45:12.365302 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Openstack-System-Scope: None Aug 01 16:45:12.365302 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: User-Agent: python-urllib3/1.26.10 Aug 01 16:45:12.365302 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Auth-Token: gAAAAABi6AMQ_WscaDoUkNb-YF1bxwVr1wxifMD1rcW3SVGIFZyhASY5Fkllb_SgQ4YLwKq83TZJZ9jwtC6KHXv9n3uh_nx-FOSqK0nDgP8JhcVZ43rcOIiqt0HllhA8uQaYmqFEwLM9dy7kOvD2VjdQmv9kq9UMXZw9kHqNV2LcWnfCC__av4w Aug 01 16:45:12.365302 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Domain-Id: None Aug 01 16:45:12.365302 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Domain-Name: None Aug 01 16:45:12.365302 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Identity-Status: Confirmed Aug 01 16:45:12.365302 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Is-Admin-Project: True Aug 01 16:45:12.365302 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Domain-Id: default Aug 01 16:45:12.365302 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Domain-Name: Default Aug 01 16:45:12.365302 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Id: c3601a4f15d84ea6b32e39f5e5a0f462 Aug 01 16:45:12.365302 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1461023420 Aug 01 16:45:12.365302 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Role: reader,member Aug 01 16:45:12.365302 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Roles: reader,member Aug 01 16:45:12.367329 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c3601a4f15d84ea6b32e39f5e5a0f462"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c3601a4f15d84ea6b32e39f5e5a0f462"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c3601a4f15d84ea6b32e39f5e5a0f462"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c3601a4f15d84ea6b32e39f5e5a0f462"}]}] Aug 01 16:45:12.367329 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1461023420 Aug 01 16:45:12.367329 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant-Id: c3601a4f15d84ea6b32e39f5e5a0f462 Aug 01 16:45:12.367329 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1461023420 Aug 01 16:45:12.367329 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User: tempest-VolumesSnapshotsTestJSON-1461023420-project Aug 01 16:45:12.367329 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Domain-Id: default Aug 01 16:45:12.367329 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Domain-Name: Default Aug 01 16:45:12.367329 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Id: 63a00b55295240d3a8b36a8cc156f667 Aug 01 16:45:12.367329 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1461023420-project Aug 01 16:45:12.367329 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: method: Aug 01 16:45:12.367329 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: exception: Volume a97c25b2-5154-465d-bdad-e21e34bab694 could not be found. Aug 01 16:45:12.367329 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: action_args: {'id': 'a97c25b2-5154-465d-bdad-e21e34bab694'} Aug 01 16:45:12.367329 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:45:12.368134 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:45:12.368134 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 16:45:12.368134 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 16:45:12.368134 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 16:45:12.368134 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 16:45:12.368134 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 16:45:12.368134 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 16:45:12.368134 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 16:45:12.368134 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 16:45:12.368134 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 16:45:12.368134 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 16:45:12.368134 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 16:45:12.368134 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 16:45:12.368134 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 16:45:12.368134 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 16:45:12.368134 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a97c25b2-5154-465d-bdad-e21e34bab694 could not be found. (HTTP 404) (Request-ID: req-bc78e8ed-894a-4b17-b864-a4389b95f8d9) Aug 01 16:45:12.368134 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:45:12.368134 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:45:12.368134 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:45:12.369300 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:45:12.369300 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 01 16:45:12.369300 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 01 16:45:12.369300 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 16:45:12.369300 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 16:45:12.369300 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 16:45:12.369300 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 16:45:12.369300 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 16:45:12.369300 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 16:45:12.369300 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 16:45:12.369300 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 16:45:12.369300 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 16:45:12.369300 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 16:45:12.369300 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 16:45:12.369300 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 16:45:12.369300 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 16:45:12.369300 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 16:45:12.369300 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 16:45:12.369300 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 16:45:12.370447 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 16:45:12.370447 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 16:45:12.370447 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 16:45:12.370447 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 16:45:12.370447 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a97c25b2-5154-465d-bdad-e21e34bab694 could not be found. Aug 01 16:45:12.370447 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:45:12.370447 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:45:12.370447 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:45:12.370447 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:45:12.370447 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:45:12.370447 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:45:12.370447 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:45:12.370447 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:45:12.370447 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 16:45:12.370447 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 16:45:12.370447 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:45:12.370447 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:45:12.370447 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 01 16:45:12.370447 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:45:12.371555 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a97c25b2-5154-465d-bdad-e21e34bab694 could not be found. Aug 01 16:45:12.371555 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:45:12.371555 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:45:12.371555 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:45:12.371555 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:45:12.371555 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:45:12.371555 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:45:12.371555 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:45:12.371555 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:45:12.371555 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a97c25b2-5154-465d-bdad-e21e34bab694 could not be found. Aug 01 16:45:12.371555 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:45:12.371555 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-3046cba3-096c-44b9-9831-e8610e57c819 tempest-VolumesSnapshotsTestJSON-1461023420 tempest-VolumesSnapshotsTestJSON-1461023420-project] Returning 404 to user: Volume a97c25b2-5154-465d-bdad-e21e34bab694 could not be found. {{(pid=118118) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:45:12.371555 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-3046cba3-096c-44b9-9831-e8610e57c819 tempest-VolumesSnapshotsTestJSON-1461023420 tempest-VolumesSnapshotsTestJSON-1461023420-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/a97c25b2-5154-465d-bdad-e21e34bab694" status: 404 len: 109 microversion: 2.1 time: 0.036604 Aug 01 16:45:12.371555 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 405/800] 10.222.0.45 () {58 vars in 1245 bytes} [Mon Aug 1 16:45:12 2022] GET /compute/v2.1/os-volumes/a97c25b2-5154-465d-bdad-e21e34bab694 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 01 16:45:13.123105 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-4dd077e3-6f44-442a-af54-73b5dfb16791 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:13.123867 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-4dd077e3-6f44-442a-af54-73b5dfb16791 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:13.132231 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-4dd077e3-6f44-442a-af54-73b5dfb16791 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:13.132715 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-4dd077e3-6f44-442a-af54-73b5dfb16791 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:13.133569 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-4dd077e3-6f44-442a-af54-73b5dfb16791 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:13.134007 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-4dd077e3-6f44-442a-af54-73b5dfb16791 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:13.310100 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-4dd077e3-6f44-442a-af54-73b5dfb16791 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:13.327194 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-4dd077e3-6f44-442a-af54-73b5dfb16791 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:13.329075 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-4dd077e3-6f44-442a-af54-73b5dfb16791 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:13.330335 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-4dd077e3-6f44-442a-af54-73b5dfb16791 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926" status: 200 len: 1724 microversion: 2.20 time: 0.211721 Aug 01 16:45:13.343795 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 396/801] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:45:13 2022] GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926 => generated 1724 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:45:14.357650 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-5068f64f-b41a-46bb-b5cb-5724ec524fd0 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:14.358526 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-5068f64f-b41a-46bb-b5cb-5724ec524fd0 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:14.365748 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-5068f64f-b41a-46bb-b5cb-5724ec524fd0 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:14.366218 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-5068f64f-b41a-46bb-b5cb-5724ec524fd0 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:14.367441 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-5068f64f-b41a-46bb-b5cb-5724ec524fd0 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:14.367953 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-5068f64f-b41a-46bb-b5cb-5724ec524fd0 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:14.518208 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-5068f64f-b41a-46bb-b5cb-5724ec524fd0 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:14.526443 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-5068f64f-b41a-46bb-b5cb-5724ec524fd0 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:14.527956 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-5068f64f-b41a-46bb-b5cb-5724ec524fd0 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:14.529106 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-5068f64f-b41a-46bb-b5cb-5724ec524fd0 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926" status: 200 len: 1724 microversion: 2.20 time: 0.176788 Aug 01 16:45:14.529736 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 406/802] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:45:14 2022] GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926 => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:45:15.425870 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-da1e13e4-789f-4695-9593-5bb9b1bff303 tempest-VolumesTestJSON-1037123089 tempest-VolumesTestJSON-1037123089-project] Calling method '.version_select at 0x7efd5eae6550>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:15.482286 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-da1e13e4-789f-4695-9593-5bb9b1bff303 tempest-VolumesTestJSON-1037123089 tempest-VolumesTestJSON-1037123089-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/771c3b32-2095-4060-abaa-b54e99692f78" status: 200 len: 350 microversion: 2.1 time: 0.060895 Aug 01 16:45:15.483287 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 397/803] 10.222.0.45 () {58 vars in 1245 bytes} [Mon Aug 1 16:45:15 2022] GET /compute/v2.1/os-volumes/771c3b32-2095-4060-abaa-b54e99692f78 => generated 350 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:45:15.552494 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-5ac807ae-8d47-434c-ac6a-50665b708375 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:15.553163 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-5ac807ae-8d47-434c-ac6a-50665b708375 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:15.563251 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-5ac807ae-8d47-434c-ac6a-50665b708375 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:15.563699 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-5ac807ae-8d47-434c-ac6a-50665b708375 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:15.564507 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-5ac807ae-8d47-434c-ac6a-50665b708375 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:15.564955 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-5ac807ae-8d47-434c-ac6a-50665b708375 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:15.726676 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-5ac807ae-8d47-434c-ac6a-50665b708375 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:15.747861 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-5ac807ae-8d47-434c-ac6a-50665b708375 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:15.749528 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-5ac807ae-8d47-434c-ac6a-50665b708375 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:15.750751 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-5ac807ae-8d47-434c-ac6a-50665b708375 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926" status: 200 len: 1724 microversion: 2.20 time: 0.202221 Aug 01 16:45:15.751338 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 407/804] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:45:15 2022] GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926 => generated 1724 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:45:16.525427 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-50fb1716-05c0-4be1-91c1-8b47c7e3cc96 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:16.527695 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-50fb1716-05c0-4be1-91c1-8b47c7e3cc96 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: e2e46d25-15d6-4671-8d04-9994875a9f96] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:16.534977 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-50fb1716-05c0-4be1-91c1-8b47c7e3cc96 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:16.535431 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-50fb1716-05c0-4be1-91c1-8b47c7e3cc96 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:16.536213 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-50fb1716-05c0-4be1-91c1-8b47c7e3cc96 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:16.536641 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-50fb1716-05c0-4be1-91c1-8b47c7e3cc96 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:16.569618 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-50fb1716-05c0-4be1-91c1-8b47c7e3cc96 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/e2e46d25-15d6-4671-8d04-9994875a9f96/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049040 Aug 01 16:45:16.570491 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 398/805] 10.222.0.45 () {58 vars in 1302 bytes} [Mon Aug 1 16:45:16 2022] GET /compute/v2.1/servers/e2e46d25-15d6-4671-8d04-9994875a9f96/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:45:16.717683 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-49454d37-8148-4499-b1ed-9cef624db679 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:16.718314 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-49454d37-8148-4499-b1ed-9cef624db679 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: e2e46d25-15d6-4671-8d04-9994875a9f96] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:16.724922 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-49454d37-8148-4499-b1ed-9cef624db679 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:16.725359 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-49454d37-8148-4499-b1ed-9cef624db679 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:16.726315 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-49454d37-8148-4499-b1ed-9cef624db679 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:16.726744 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-49454d37-8148-4499-b1ed-9cef624db679 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:16.757057 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-49454d37-8148-4499-b1ed-9cef624db679 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/e2e46d25-15d6-4671-8d04-9994875a9f96/os-volume_attachments/ed6e5785-40e9-4f89-9318-b45f3c5733cf" status: 200 len: 194 microversion: 2.1 time: 0.043400 Aug 01 16:45:16.758010 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 408/806] 10.222.0.45 () {58 vars in 1413 bytes} [Mon Aug 1 16:45:16 2022] GET /compute/v2.1/servers/e2e46d25-15d6-4671-8d04-9994875a9f96/os-volume_attachments/ed6e5785-40e9-4f89-9318-b45f3c5733cf => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:45:16.769087 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-24ac59bb-d451-4d4a-bc64-6bb31538ebba tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:16.769584 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-24ac59bb-d451-4d4a-bc64-6bb31538ebba tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: e2e46d25-15d6-4671-8d04-9994875a9f96] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:16.776669 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-5ea6169c-16dc-4f06-b979-209bbf474723 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:16.776992 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-24ac59bb-d451-4d4a-bc64-6bb31538ebba tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:16.777269 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-5ea6169c-16dc-4f06-b979-209bbf474723 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:16.777500 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-24ac59bb-d451-4d4a-bc64-6bb31538ebba tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:16.778112 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-24ac59bb-d451-4d4a-bc64-6bb31538ebba tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:16.778543 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-24ac59bb-d451-4d4a-bc64-6bb31538ebba tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:16.784203 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-5ea6169c-16dc-4f06-b979-209bbf474723 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:16.784647 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-5ea6169c-16dc-4f06-b979-209bbf474723 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:16.785423 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-5ea6169c-16dc-4f06-b979-209bbf474723 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:16.785841 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-5ea6169c-16dc-4f06-b979-209bbf474723 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:16.882232 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.objects.instance [None req-24ac59bb-d451-4d4a-bc64-6bb31538ebba tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lazy-loading 'services' on Instance uuid e2e46d25-15d6-4671-8d04-9994875a9f96 {{(pid=118117) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 16:45:16.955321 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-5ea6169c-16dc-4f06-b979-209bbf474723 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:16.966433 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-5ea6169c-16dc-4f06-b979-209bbf474723 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:16.967800 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-5ea6169c-16dc-4f06-b979-209bbf474723 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:16.969003 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-5ea6169c-16dc-4f06-b979-209bbf474723 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926" status: 200 len: 1745 microversion: 2.20 time: 0.196498 Aug 01 16:45:16.969563 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 409/807] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:45:16 2022] GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926 => generated 1745 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 16:45:16.974171 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-7743a069-6a52-445a-9736-baa8072562ec tempest-VolumesTestJSON-1037123089 tempest-VolumesTestJSON-1037123089-project] Calling method '.version_select at 0x7efd674d89d0>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:16.974487 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-24ac59bb-d451-4d4a-bc64-6bb31538ebba tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "DELETE /compute/v2.1/servers/e2e46d25-15d6-4671-8d04-9994875a9f96/os-volume_attachments/ed6e5785-40e9-4f89-9318-b45f3c5733cf" status: 202 len: 0 microversion: 2.1 time: 0.209133 Aug 01 16:45:16.975352 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 399/808] 10.222.0.45 () {58 vars in 1416 bytes} [Mon Aug 1 16:45:16 2022] DELETE /compute/v2.1/servers/e2e46d25-15d6-4671-8d04-9994875a9f96/os-volume_attachments/ed6e5785-40e9-4f89-9318-b45f3c5733cf => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 16:45:17.058455 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-7743a069-6a52-445a-9736-baa8072562ec tempest-VolumesTestJSON-1037123089 tempest-VolumesTestJSON-1037123089-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/9cf23f1b-e2b8-4b88-aba3-f4656fb5c74d" status: 200 len: 350 microversion: 2.1 time: 0.079018 Aug 01 16:45:17.059521 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 410/809] 10.222.0.45 () {58 vars in 1245 bytes} [Mon Aug 1 16:45:16 2022] GET /compute/v2.1/os-volumes/9cf23f1b-e2b8-4b88-aba3-f4656fb5c74d => generated 350 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:45:17.996265 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-a99239b0-4bbb-4204-8ee1-9866cb3b3037 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:17.997008 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-a99239b0-4bbb-4204-8ee1-9866cb3b3037 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:18.004471 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-a99239b0-4bbb-4204-8ee1-9866cb3b3037 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:18.004918 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-a99239b0-4bbb-4204-8ee1-9866cb3b3037 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:18.005705 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-a99239b0-4bbb-4204-8ee1-9866cb3b3037 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:18.006117 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-a99239b0-4bbb-4204-8ee1-9866cb3b3037 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:18.199307 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-a99239b0-4bbb-4204-8ee1-9866cb3b3037 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:18.213690 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-a99239b0-4bbb-4204-8ee1-9866cb3b3037 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:18.217161 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-a99239b0-4bbb-4204-8ee1-9866cb3b3037 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:18.219176 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-a99239b0-4bbb-4204-8ee1-9866cb3b3037 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926" status: 200 len: 1745 microversion: 2.20 time: 0.227854 Aug 01 16:45:18.220125 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 400/810] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:45:17 2022] GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926 => generated 1745 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:45:18.524853 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-4961c135-73cf-415f-9f11-c0397ccca68e tempest-VolumesTestJSON-1037123089 tempest-VolumesTestJSON-1037123089-project] Calling method '.version_select at 0x7efd67443790>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:18.581225 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-4961c135-73cf-415f-9f11-c0397ccca68e tempest-VolumesTestJSON-1037123089 tempest-VolumesTestJSON-1037123089-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/7c77ec2d-e537-4067-bced-1565c6851e17" status: 200 len: 350 microversion: 2.1 time: 0.060431 Aug 01 16:45:18.589877 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 411/811] 10.222.0.45 () {58 vars in 1245 bytes} [Mon Aug 1 16:45:18 2022] GET /compute/v2.1/os-volumes/7c77ec2d-e537-4067-bced-1565c6851e17 => generated 350 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 16:45:18.606418 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-a765743c-0039-4374-a483-6c7443869d92 tempest-VolumesTestJSON-1037123089 tempest-VolumesTestJSON-1037123089-project] Calling method '.version_select at 0x7efd5ea8b940>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:18.720983 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-a765743c-0039-4374-a483-6c7443869d92 tempest-VolumesTestJSON-1037123089 tempest-VolumesTestJSON-1037123089-project] 10.222.0.45 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.122715 Aug 01 16:45:18.721648 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 401/812] 10.222.0.45 () {58 vars in 1134 bytes} [Mon Aug 1 16:45:18 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:45:18.737623 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-6c4edf55-9ab5-4970-9475-e90c22c8bbcd tempest-VolumesTestJSON-1037123089 tempest-VolumesTestJSON-1037123089-project] Calling method '.version_select at 0x7efd67443c10>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:18.856591 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-6c4edf55-9ab5-4970-9475-e90c22c8bbcd tempest-VolumesTestJSON-1037123089 tempest-VolumesTestJSON-1037123089-project] 10.222.0.45 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.123809 Aug 01 16:45:18.857173 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 412/813] 10.222.0.45 () {58 vars in 1149 bytes} [Mon Aug 1 16:45:18 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:45:18.884401 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-8624958a-9bee-43cb-8f94-f8cf6211efea tempest-VolumesTestJSON-1037123089 tempest-VolumesTestJSON-1037123089-project] Calling method '.version_select at 0x7efd5e988af0>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:19.066251 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-8624958a-9bee-43cb-8f94-f8cf6211efea tempest-VolumesTestJSON-1037123089 tempest-VolumesTestJSON-1037123089-project] 10.222.0.45 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.190113 Aug 01 16:45:19.066867 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 402/814] 10.222.0.45 () {58 vars in 1134 bytes} [Mon Aug 1 16:45:18 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:45:19.086328 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-89774689-c2f1-4ea3-97c9-a07b41341d43 tempest-VolumesTestJSON-1037123089 tempest-VolumesTestJSON-1037123089-project] Calling method '.version_select at 0x7efd67443af0>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:19.203542 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-89774689-c2f1-4ea3-97c9-a07b41341d43 tempest-VolumesTestJSON-1037123089 tempest-VolumesTestJSON-1037123089-project] 10.222.0.45 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.123907 Aug 01 16:45:19.212047 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 413/815] 10.222.0.45 () {58 vars in 1167 bytes} [Mon Aug 1 16:45:19 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:45:19.226513 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-52e43023-f9ff-4cf0-bf8e-9482c612976a tempest-VolumesTestJSON-1037123089 tempest-VolumesTestJSON-1037123089-project] Calling method '.version_select at 0x7efd5e988b80>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:19.244022 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-01411b79-f654-4f64-b9ff-9910a117f7a9 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:19.244884 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-01411b79-f654-4f64-b9ff-9910a117f7a9 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: e2e46d25-15d6-4671-8d04-9994875a9f96] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:19.256608 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-01411b79-f654-4f64-b9ff-9910a117f7a9 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:19.257579 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-01411b79-f654-4f64-b9ff-9910a117f7a9 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:19.259304 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-01411b79-f654-4f64-b9ff-9910a117f7a9 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:19.260095 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-01411b79-f654-4f64-b9ff-9910a117f7a9 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:19.284640 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:45:19.304524 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-01411b79-f654-4f64-b9ff-9910a117f7a9 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/e2e46d25-15d6-4671-8d04-9994875a9f96/os-volume_attachments/2e24b2dc-7dbd-47a3-8c70-6e4bde7d1c90" status: 200 len: 194 microversion: 2.1 time: 0.068251 Aug 01 16:45:19.312521 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 414/816] 10.222.0.45 () {58 vars in 1413 bytes} [Mon Aug 1 16:45:19 2022] GET /compute/v2.1/servers/e2e46d25-15d6-4671-8d04-9994875a9f96/os-volume_attachments/2e24b2dc-7dbd-47a3-8c70-6e4bde7d1c90 => generated 194 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:45:19.312521 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-274dbc0b-7ecb-43bd-ac8d-255d5c84bda4 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:19.312521 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-274dbc0b-7ecb-43bd-ac8d-255d5c84bda4 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:19.318388 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-274dbc0b-7ecb-43bd-ac8d-255d5c84bda4 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:19.319078 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-274dbc0b-7ecb-43bd-ac8d-255d5c84bda4 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:19.320455 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-274dbc0b-7ecb-43bd-ac8d-255d5c84bda4 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:19.320455 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-274dbc0b-7ecb-43bd-ac8d-255d5c84bda4 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:19.333307 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-52e43023-f9ff-4cf0-bf8e-9482c612976a tempest-VolumesTestJSON-1037123089 tempest-VolumesTestJSON-1037123089-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.111265 Aug 01 16:45:19.334078 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 403/817] 10.222.0.45 () {58 vars in 1170 bytes} [Mon Aug 1 16:45:19 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 16:45:19.350403 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-5ddbdf3f-9433-40bc-b152-96046d9639b9 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:19.351246 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-5ddbdf3f-9433-40bc-b152-96046d9639b9 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: e2e46d25-15d6-4671-8d04-9994875a9f96] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:19.360497 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-5ddbdf3f-9433-40bc-b152-96046d9639b9 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:19.361214 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-5ddbdf3f-9433-40bc-b152-96046d9639b9 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:19.362412 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-5ddbdf3f-9433-40bc-b152-96046d9639b9 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:19.362981 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-5ddbdf3f-9433-40bc-b152-96046d9639b9 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:19.495591 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.objects.instance [None req-5ddbdf3f-9433-40bc-b152-96046d9639b9 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lazy-loading 'services' on Instance uuid e2e46d25-15d6-4671-8d04-9994875a9f96 {{(pid=118117) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 16:45:19.543578 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-274dbc0b-7ecb-43bd-ac8d-255d5c84bda4 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:19.575159 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-274dbc0b-7ecb-43bd-ac8d-255d5c84bda4 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:19.579230 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-274dbc0b-7ecb-43bd-ac8d-255d5c84bda4 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:19.581597 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-274dbc0b-7ecb-43bd-ac8d-255d5c84bda4 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926" status: 200 len: 1740 microversion: 2.20 time: 0.275034 Aug 01 16:45:19.582620 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 415/818] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:45:19 2022] GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926 => generated 1740 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:45:19.593646 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-670ce7b3-0b88-41d3-bbf8-6007a098e674 tempest-VolumesTestJSON-1037123089 tempest-VolumesTestJSON-1037123089-project] Calling method '.version_select at 0x7efd674433a0>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:19.638248 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-5ddbdf3f-9433-40bc-b152-96046d9639b9 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "DELETE /compute/v2.1/servers/e2e46d25-15d6-4671-8d04-9994875a9f96/os-volume_attachments/2e24b2dc-7dbd-47a3-8c70-6e4bde7d1c90" status: 202 len: 0 microversion: 2.1 time: 0.301662 Aug 01 16:45:19.639365 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 404/819] 10.222.0.45 () {58 vars in 1416 bytes} [Mon Aug 1 16:45:19 2022] DELETE /compute/v2.1/servers/e2e46d25-15d6-4671-8d04-9994875a9f96/os-volume_attachments/2e24b2dc-7dbd-47a3-8c70-6e4bde7d1c90 => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 16:45:19.738891 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-670ce7b3-0b88-41d3-bbf8-6007a098e674 tempest-VolumesTestJSON-1037123089 tempest-VolumesTestJSON-1037123089-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.153193 Aug 01 16:45:19.739919 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 416/820] 10.222.0.45 () {58 vars in 1155 bytes} [Mon Aug 1 16:45:19 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:45:19.755271 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-02867bb4-0766-4b5b-9666-440dae8c68f2 tempest-VolumesTestJSON-1037123089 tempest-VolumesTestJSON-1037123089-project] Calling method '.version_select at 0x7efd5eae6040>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:19.884258 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-02867bb4-0766-4b5b-9666-440dae8c68f2 tempest-VolumesTestJSON-1037123089 tempest-VolumesTestJSON-1037123089-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.133564 Aug 01 16:45:19.885377 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 405/821] 10.222.0.45 () {58 vars in 1188 bytes} [Mon Aug 1 16:45:19 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:45:19.906487 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-fc99a5ce-6ee3-49d9-ad78-0c4fe8433166 tempest-VolumesTestJSON-1037123089 tempest-VolumesTestJSON-1037123089-project] Calling method '.version_select at 0x7efd5ece9310>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:20.081014 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-fc99a5ce-6ee3-49d9-ad78-0c4fe8433166 tempest-VolumesTestJSON-1037123089 tempest-VolumesTestJSON-1037123089-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.181669 Aug 01 16:45:20.096405 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 417/822] 10.222.0.45 () {58 vars in 1155 bytes} [Mon Aug 1 16:45:19 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:45:20.609182 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-55ee702f-3764-4bfc-bac0-ac0f92221602 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:20.610056 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-55ee702f-3764-4bfc-bac0-ac0f92221602 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:20.799249 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-55ee702f-3764-4bfc-bac0-ac0f92221602 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:20.800047 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-55ee702f-3764-4bfc-bac0-ac0f92221602 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:20.801075 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-55ee702f-3764-4bfc-bac0-ac0f92221602 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:20.801712 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-55ee702f-3764-4bfc-bac0-ac0f92221602 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:21.137208 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-55ee702f-3764-4bfc-bac0-ac0f92221602 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:21.148198 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-55ee702f-3764-4bfc-bac0-ac0f92221602 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:21.150153 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-55ee702f-3764-4bfc-bac0-ac0f92221602 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:21.160825 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-55ee702f-3764-4bfc-bac0-ac0f92221602 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926" status: 200 len: 1740 microversion: 2.20 time: 0.555669 Aug 01 16:45:21.162336 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 406/823] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:45:20 2022] GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926 => generated 1740 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:45:21.168642 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-7406c9f1-6ca8-48c0-83c9-677fe4fdc2eb tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:21.171682 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-7406c9f1-6ca8-48c0-83c9-677fe4fdc2eb tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: e2e46d25-15d6-4671-8d04-9994875a9f96] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:21.194647 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-7406c9f1-6ca8-48c0-83c9-677fe4fdc2eb tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:21.195516 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-7406c9f1-6ca8-48c0-83c9-677fe4fdc2eb tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:21.196533 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-7406c9f1-6ca8-48c0-83c9-677fe4fdc2eb tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:21.197184 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-7406c9f1-6ca8-48c0-83c9-677fe4fdc2eb tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:21.255994 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-7406c9f1-6ca8-48c0-83c9-677fe4fdc2eb tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/e2e46d25-15d6-4671-8d04-9994875a9f96/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.091764 Aug 01 16:45:21.262990 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 407/824] 10.222.0.45 () {58 vars in 1302 bytes} [Mon Aug 1 16:45:21 2022] GET /compute/v2.1/servers/e2e46d25-15d6-4671-8d04-9994875a9f96/os-volume_attachments => generated 25 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 16:45:21.315994 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [req-6f467530-60c3-443f-be94-d7aa72b14803 req-89ede60f-4699-49b0-b1f9-66ec36c8ac78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "144c8e15-97cd-4e0d-9d60-2ba97c26e926", "name": "network-vif-plugged", "status": "completed", "tag": "4f59fd5b-8ef2-4634-a3a5-063fd9fa3526"}]} {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:45:21.342903 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-6f467530-60c3-443f-be94-d7aa72b14803 req-89ede60f-4699-49b0-b1f9-66ec36c8ac78 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:21.344768 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-6f467530-60c3-443f-be94-d7aa72b14803 req-89ede60f-4699-49b0-b1f9-66ec36c8ac78 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:21.377018 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.compute.server_external_events [req-6f467530-60c3-443f-be94-d7aa72b14803 req-89ede60f-4699-49b0-b1f9-66ec36c8ac78 service nova] Creating event network-vif-plugged:4f59fd5b-8ef2-4634-a3a5-063fd9fa3526 for instance 144c8e15-97cd-4e0d-9d60-2ba97c26e926 on hv-cinder-85032 Aug 01 16:45:21.386923 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [req-6f467530-60c3-443f-be94-d7aa72b14803 req-89ede60f-4699-49b0-b1f9-66ec36c8ac78 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.412940 Aug 01 16:45:21.389259 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 418/825] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:45:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 16:45:21.580712 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-28488380-8c3f-416b-a43f-1469e536fdbb tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:21.583068 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-28488380-8c3f-416b-a43f-1469e536fdbb tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: e2e46d25-15d6-4671-8d04-9994875a9f96] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:21.592865 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-28488380-8c3f-416b-a43f-1469e536fdbb tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:21.592865 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-28488380-8c3f-416b-a43f-1469e536fdbb tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:21.592865 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-28488380-8c3f-416b-a43f-1469e536fdbb tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:21.592865 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-28488380-8c3f-416b-a43f-1469e536fdbb tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:21.635558 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-28488380-8c3f-416b-a43f-1469e536fdbb tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/e2e46d25-15d6-4671-8d04-9994875a9f96/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058642 Aug 01 16:45:21.636945 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 408/826] 10.222.0.45 () {58 vars in 1302 bytes} [Mon Aug 1 16:45:21 2022] GET /compute/v2.1/servers/e2e46d25-15d6-4671-8d04-9994875a9f96/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 01 16:45:21.774158 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-00358cb0-a89c-4c8e-a061-607357e6ad69 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:21.775535 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-00358cb0-a89c-4c8e-a061-607357e6ad69 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: e2e46d25-15d6-4671-8d04-9994875a9f96] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:21.789516 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-00358cb0-a89c-4c8e-a061-607357e6ad69 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:21.790609 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-00358cb0-a89c-4c8e-a061-607357e6ad69 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:21.792339 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-00358cb0-a89c-4c8e-a061-607357e6ad69 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:21.793469 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-00358cb0-a89c-4c8e-a061-607357e6ad69 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:21.836065 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-00358cb0-a89c-4c8e-a061-607357e6ad69 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: e2e46d25-15d6-4671-8d04-9994875a9f96] Going to try to terminate instance {{(pid=118118) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 16:45:21.969824 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-00358cb0-a89c-4c8e-a061-607357e6ad69 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "DELETE /compute/v2.1/servers/e2e46d25-15d6-4671-8d04-9994875a9f96" status: 204 len: 0 microversion: 2.1 time: 0.202490 Aug 01 16:45:21.974022 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 419/827] 10.222.0.45 () {58 vars in 1239 bytes} [Mon Aug 1 16:45:21 2022] DELETE /compute/v2.1/servers/e2e46d25-15d6-4671-8d04-9994875a9f96 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 01 16:45:21.980871 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-c99b010c-a2c5-49fa-a44e-b488dd8fd0fd tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:21.988564 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-c99b010c-a2c5-49fa-a44e-b488dd8fd0fd tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: e2e46d25-15d6-4671-8d04-9994875a9f96] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:21.998922 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-c99b010c-a2c5-49fa-a44e-b488dd8fd0fd tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:22.000040 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-c99b010c-a2c5-49fa-a44e-b488dd8fd0fd tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:22.001294 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-c99b010c-a2c5-49fa-a44e-b488dd8fd0fd tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:22.001989 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-c99b010c-a2c5-49fa-a44e-b488dd8fd0fd tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:22.211650 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-8859821c-9b48-41b9-a983-8ef5a0d383f9 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:22.212587 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-8859821c-9b48-41b9-a983-8ef5a0d383f9 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:22.227991 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-8859821c-9b48-41b9-a983-8ef5a0d383f9 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:22.228921 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-8859821c-9b48-41b9-a983-8ef5a0d383f9 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:22.230266 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-8859821c-9b48-41b9-a983-8ef5a0d383f9 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:22.230859 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-8859821c-9b48-41b9-a983-8ef5a0d383f9 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:22.236639 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-c99b010c-a2c5-49fa-a44e-b488dd8fd0fd tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0aed0278344119aae6906f4f52b1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b66d46c3e7d42b88f2dbdc01232fb03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:22.255005 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-c99b010c-a2c5-49fa-a44e-b488dd8fd0fd tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/e2e46d25-15d6-4671-8d04-9994875a9f96" status: 200 len: 1673 microversion: 2.1 time: 0.279147 Aug 01 16:45:22.257194 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 409/828] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:45:21 2022] GET /compute/v2.1/servers/e2e46d25-15d6-4671-8d04-9994875a9f96 => generated 1673 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:45:22.474478 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-8859821c-9b48-41b9-a983-8ef5a0d383f9 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:22.496912 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-8859821c-9b48-41b9-a983-8ef5a0d383f9 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:22.499886 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-8859821c-9b48-41b9-a983-8ef5a0d383f9 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:22.501996 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-8859821c-9b48-41b9-a983-8ef5a0d383f9 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926" status: 200 len: 1740 microversion: 2.20 time: 0.296358 Aug 01 16:45:22.503409 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 420/829] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:45:22 2022] GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926 => generated 1740 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:45:23.289558 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-0c08bd85-1438-4f05-b1f1-339d2ec0c685 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:23.290928 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-0c08bd85-1438-4f05-b1f1-339d2ec0c685 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: e2e46d25-15d6-4671-8d04-9994875a9f96] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:23.299922 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-0c08bd85-1438-4f05-b1f1-339d2ec0c685 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:23.300517 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-0c08bd85-1438-4f05-b1f1-339d2ec0c685 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:23.302034 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-0c08bd85-1438-4f05-b1f1-339d2ec0c685 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:23.303153 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-0c08bd85-1438-4f05-b1f1-339d2ec0c685 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:23.538341 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-12adac0d-d853-4368-a8dc-046b42b862a6 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:23.540001 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-12adac0d-d853-4368-a8dc-046b42b862a6 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:23.550366 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-0c08bd85-1438-4f05-b1f1-339d2ec0c685 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0aed0278344119aae6906f4f52b1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b66d46c3e7d42b88f2dbdc01232fb03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:23.551056 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-12adac0d-d853-4368-a8dc-046b42b862a6 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:23.551056 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-12adac0d-d853-4368-a8dc-046b42b862a6 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:23.552020 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-12adac0d-d853-4368-a8dc-046b42b862a6 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:23.552520 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-12adac0d-d853-4368-a8dc-046b42b862a6 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:23.560384 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-0c08bd85-1438-4f05-b1f1-339d2ec0c685 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/e2e46d25-15d6-4671-8d04-9994875a9f96" status: 200 len: 1673 microversion: 2.1 time: 0.275102 Aug 01 16:45:23.560955 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 410/830] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:45:23 2022] GET /compute/v2.1/servers/e2e46d25-15d6-4671-8d04-9994875a9f96 => generated 1673 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:45:23.772369 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-12adac0d-d853-4368-a8dc-046b42b862a6 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:23.780627 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-12adac0d-d853-4368-a8dc-046b42b862a6 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:23.782137 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-12adac0d-d853-4368-a8dc-046b42b862a6 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:23.783336 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-12adac0d-d853-4368-a8dc-046b42b862a6 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926" status: 200 len: 1740 microversion: 2.20 time: 0.252337 Aug 01 16:45:23.784285 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 421/831] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:45:23 2022] GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926 => generated 1740 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:45:24.596612 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-af0206fa-b1cd-47c4-8640-a3fa15a3aa73 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:24.597176 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-af0206fa-b1cd-47c4-8640-a3fa15a3aa73 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: e2e46d25-15d6-4671-8d04-9994875a9f96] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:24.611184 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-af0206fa-b1cd-47c4-8640-a3fa15a3aa73 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:24.612178 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-af0206fa-b1cd-47c4-8640-a3fa15a3aa73 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:24.613315 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-af0206fa-b1cd-47c4-8640-a3fa15a3aa73 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:24.614029 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-af0206fa-b1cd-47c4-8640-a3fa15a3aa73 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:24.751458 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-af0206fa-b1cd-47c4-8640-a3fa15a3aa73 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0aed0278344119aae6906f4f52b1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b66d46c3e7d42b88f2dbdc01232fb03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:24.760159 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-af0206fa-b1cd-47c4-8640-a3fa15a3aa73 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/e2e46d25-15d6-4671-8d04-9994875a9f96" status: 200 len: 1605 microversion: 2.1 time: 0.168116 Aug 01 16:45:24.768539 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 411/832] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:45:24 2022] GET /compute/v2.1/servers/e2e46d25-15d6-4671-8d04-9994875a9f96 => generated 1605 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:45:24.824510 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-2eece1fa-ba3c-4f97-bcfc-4d7ede9b2286 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:24.825579 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-2eece1fa-ba3c-4f97-bcfc-4d7ede9b2286 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:24.840710 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-2eece1fa-ba3c-4f97-bcfc-4d7ede9b2286 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:24.841482 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-2eece1fa-ba3c-4f97-bcfc-4d7ede9b2286 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:24.842836 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-2eece1fa-ba3c-4f97-bcfc-4d7ede9b2286 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:24.843563 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-2eece1fa-ba3c-4f97-bcfc-4d7ede9b2286 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:25.183025 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-2eece1fa-ba3c-4f97-bcfc-4d7ede9b2286 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:25.193335 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-2eece1fa-ba3c-4f97-bcfc-4d7ede9b2286 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:25.201136 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-2eece1fa-ba3c-4f97-bcfc-4d7ede9b2286 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:25.202773 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-2eece1fa-ba3c-4f97-bcfc-4d7ede9b2286 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926" status: 200 len: 1740 microversion: 2.20 time: 0.387539 Aug 01 16:45:25.204094 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 422/833] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:45:24 2022] GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926 => generated 1740 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:45:25.395606 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [req-89f8c4c3-677e-495e-a97f-385c5958cf67 req-111200c8-7c8c-4912-9008-2752a4c4dd6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2e46d25-15d6-4671-8d04-9994875a9f96", "name": "network-vif-deleted", "tag": "d8d32320-e56a-4eb6-ab5a-25467f73451f"}]} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:45:25.417272 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-89f8c4c3-677e-495e-a97f-385c5958cf67 req-111200c8-7c8c-4912-9008-2752a4c4dd6d service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:25.417755 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-89f8c4c3-677e-495e-a97f-385c5958cf67 req-111200c8-7c8c-4912-9008-2752a4c4dd6d service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:25.491791 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.compute.server_external_events [req-89f8c4c3-677e-495e-a97f-385c5958cf67 req-111200c8-7c8c-4912-9008-2752a4c4dd6d service nova] Creating event network-vif-deleted:d8d32320-e56a-4eb6-ab5a-25467f73451f for instance e2e46d25-15d6-4671-8d04-9994875a9f96 on hv-cinder-85032 Aug 01 16:45:25.505945 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [req-89f8c4c3-677e-495e-a97f-385c5958cf67 req-111200c8-7c8c-4912-9008-2752a4c4dd6d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113285 Aug 01 16:45:25.508386 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 412/834] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:45:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:45:25.797674 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-1880c9e7-02d2-4306-a18f-192dfe63775c tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:25.798580 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-1880c9e7-02d2-4306-a18f-192dfe63775c tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: e2e46d25-15d6-4671-8d04-9994875a9f96] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:25.808106 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-1880c9e7-02d2-4306-a18f-192dfe63775c tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:25.809519 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-1880c9e7-02d2-4306-a18f-192dfe63775c tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:25.810638 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-1880c9e7-02d2-4306-a18f-192dfe63775c tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:25.811271 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-1880c9e7-02d2-4306-a18f-192dfe63775c tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:25.874392 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-1880c9e7-02d2-4306-a18f-192dfe63775c tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:25.875188 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-1880c9e7-02d2-4306-a18f-192dfe63775c tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:25.876133 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.objects.instance [None req-1880c9e7-02d2-4306-a18f-192dfe63775c tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lazy-loading 'fault' on Instance uuid e2e46d25-15d6-4671-8d04-9994875a9f96 {{(pid=118118) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 16:45:25.994938 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-1880c9e7-02d2-4306-a18f-192dfe63775c tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b0aed0278344119aae6906f4f52b1e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b66d46c3e7d42b88f2dbdc01232fb03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:26.006460 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-1880c9e7-02d2-4306-a18f-192dfe63775c tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/e2e46d25-15d6-4671-8d04-9994875a9f96" status: 200 len: 1327 microversion: 2.1 time: 0.214884 Aug 01 16:45:26.008129 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 423/835] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:45:25 2022] GET /compute/v2.1/servers/e2e46d25-15d6-4671-8d04-9994875a9f96 => generated 1327 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:45:26.239923 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-d36bcf1d-e068-4642-a325-2283e192f3ab tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:26.240681 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-d36bcf1d-e068-4642-a325-2283e192f3ab tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:26.252742 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-d36bcf1d-e068-4642-a325-2283e192f3ab tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:26.253225 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-d36bcf1d-e068-4642-a325-2283e192f3ab tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:26.254230 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-d36bcf1d-e068-4642-a325-2283e192f3ab tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:26.254661 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-d36bcf1d-e068-4642-a325-2283e192f3ab tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:26.375180 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-71d3a2ee-a518-4258-8001-c6a9dc83527c tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:26.376532 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-71d3a2ee-a518-4258-8001-c6a9dc83527c tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 064171b4-a8a9-498c-bbd9-f51ff91afdc7] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:26.380261 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:45:26.404367 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-71d3a2ee-a518-4258-8001-c6a9dc83527c tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:26.405103 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-71d3a2ee-a518-4258-8001-c6a9dc83527c tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:26.406315 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-71d3a2ee-a518-4258-8001-c6a9dc83527c tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:26.409692 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-71d3a2ee-a518-4258-8001-c6a9dc83527c tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:26.458371 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-71d3a2ee-a518-4258-8001-c6a9dc83527c tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/064171b4-a8a9-498c-bbd9-f51ff91afdc7/ips" status: 200 len: 149 microversion: 2.1 time: 0.090129 Aug 01 16:45:26.459743 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 424/836] 10.222.0.45 () {58 vars in 1248 bytes} [Mon Aug 1 16:45:26 2022] GET /compute/v2.1/servers/064171b4-a8a9-498c-bbd9-f51ff91afdc7/ips => generated 149 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 16:45:26.514158 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-d36bcf1d-e068-4642-a325-2283e192f3ab tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:26.516867 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:45:26.525271 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-d36bcf1d-e068-4642-a325-2283e192f3ab tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:26.534677 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-d36bcf1d-e068-4642-a325-2283e192f3ab tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:26.535966 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-d36bcf1d-e068-4642-a325-2283e192f3ab tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926" status: 200 len: 1740 microversion: 2.20 time: 0.301274 Aug 01 16:45:26.541582 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 413/837] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:45:26 2022] GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926 => generated 1740 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:45:27.033717 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-4321fa43-59e8-48c4-8863-75c6113b4c14 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:27.034456 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-4321fa43-59e8-48c4-8863-75c6113b4c14 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: e2e46d25-15d6-4671-8d04-9994875a9f96] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:27.051726 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-4321fa43-59e8-48c4-8863-75c6113b4c14 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:27.052391 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-4321fa43-59e8-48c4-8863-75c6113b4c14 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:27.053426 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-4321fa43-59e8-48c4-8863-75c6113b4c14 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:27.054730 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-4321fa43-59e8-48c4-8863-75c6113b4c14 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:27.076638 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.wsgi [None req-4321fa43-59e8-48c4-8863-75c6113b4c14 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] HTTP exception thrown: Instance e2e46d25-15d6-4671-8d04-9994875a9f96 could not be found. Aug 01 16:45:27.078647 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-4321fa43-59e8-48c4-8863-75c6113b4c14 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Request method failure captured: Aug 01 16:45:27.078647 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: request: GET /compute/v2.1/servers/e2e46d25-15d6-4671-8d04-9994875a9f96 HTTP/1.1 Aug 01 16:45:27.078647 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Accept: application/json Aug 01 16:45:27.078647 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Accept-Encoding: identity Aug 01 16:45:27.078647 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Connection: close Aug 01 16:45:27.078647 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Content-Length: 0 Aug 01 16:45:27.078647 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Content-Type: application/json Aug 01 16:45:27.078647 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Host: 10.222.0.45 Aug 01 16:45:27.078647 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Openstack-System-Scope: None Aug 01 16:45:27.078647 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: User-Agent: python-urllib3/1.26.10 Aug 01 16:45:27.078647 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Auth-Token: gAAAAABi6AGyF0jsgYFh-A6y8l3Cn9YYm_pAkGAEG5bnQ2lr6MMYmVbqcoHdLrdkj9hZOvDEvf13Fnl9l68PRDdoffNcGLU3Am-BrhB1pdShu1fwRtyPe5h2ZeKYs1SoojvhOtT0OwtQA3DtUTyNaoSEKCj_5NgMhJf8Ty6o-I__-y_6ux_RLAg Aug 01 16:45:27.078647 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Domain-Id: None Aug 01 16:45:27.078647 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Domain-Name: None Aug 01 16:45:27.078647 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Identity-Status: Confirmed Aug 01 16:45:27.078647 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Is-Admin-Project: True Aug 01 16:45:27.078647 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Domain-Id: default Aug 01 16:45:27.078647 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Domain-Name: Default Aug 01 16:45:27.078647 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Id: 1b66d46c3e7d42b88f2dbdc01232fb03 Aug 01 16:45:27.078647 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Name: tempest-AttachVolumeTestJSON-231018232 Aug 01 16:45:27.078647 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Role: reader,member Aug 01 16:45:27.078647 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Roles: reader,member Aug 01 16:45:27.080521 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_1b66d46c3e7d42b88f2dbdc01232fb03"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/1b66d46c3e7d42b88f2dbdc01232fb03"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1b66d46c3e7d42b88f2dbdc01232fb03"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1b66d46c3e7d42b88f2dbdc01232fb03"}]}] Aug 01 16:45:27.080521 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant: tempest-AttachVolumeTestJSON-231018232 Aug 01 16:45:27.080521 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant-Id: 1b66d46c3e7d42b88f2dbdc01232fb03 Aug 01 16:45:27.080521 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant-Name: tempest-AttachVolumeTestJSON-231018232 Aug 01 16:45:27.080521 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User: tempest-AttachVolumeTestJSON-231018232-project Aug 01 16:45:27.080521 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Domain-Id: default Aug 01 16:45:27.080521 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Domain-Name: Default Aug 01 16:45:27.080521 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Id: 4b0aed0278344119aae6906f4f52b1e5 Aug 01 16:45:27.080521 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Name: tempest-AttachVolumeTestJSON-231018232-project Aug 01 16:45:27.080521 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: method: > Aug 01 16:45:27.080521 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: exception: Instance e2e46d25-15d6-4671-8d04-9994875a9f96 could not be found. Aug 01 16:45:27.080521 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: action_args: {'id': 'e2e46d25-15d6-4671-8d04-9994875a9f96'} Aug 01 16:45:27.081477 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:45:27.081477 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:45:27.081477 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 16:45:27.081477 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 16:45:27.081477 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 16:45:27.081477 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 16:45:27.081477 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 16:45:27.081477 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 16:45:27.081477 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 16:45:27.081477 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 16:45:27.081477 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2e46d25-15d6-4671-8d04-9994875a9f96 could not be found. Aug 01 16:45:27.081477 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:45:27.081477 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:45:27.081477 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:45:27.081477 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:45:27.081477 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:45:27.081477 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:45:27.081477 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:45:27.081477 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:45:27.081477 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:45:27.082942 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:45:27.082942 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 16:45:27.082942 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 16:45:27.082942 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 16:45:27.082942 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 16:45:27.082942 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 16:45:27.082942 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:45:27.082942 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2e46d25-15d6-4671-8d04-9994875a9f96 could not be found. Aug 01 16:45:27.082942 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:45:27.082942 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:45:27.082942 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:45:27.082942 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:45:27.082942 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:45:27.082942 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:45:27.082942 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:45:27.082942 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:45:27.082942 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2e46d25-15d6-4671-8d04-9994875a9f96 could not be found. Aug 01 16:45:27.082942 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:45:27.086431 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-4321fa43-59e8-48c4-8863-75c6113b4c14 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Returning 404 to user: Instance e2e46d25-15d6-4671-8d04-9994875a9f96 could not be found. {{(pid=118118) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:45:27.087701 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-4321fa43-59e8-48c4-8863-75c6113b4c14 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/e2e46d25-15d6-4671-8d04-9994875a9f96" status: 404 len: 111 microversion: 2.1 time: 0.058874 Aug 01 16:45:27.089180 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 425/838] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:45:27 2022] GET /compute/v2.1/servers/e2e46d25-15d6-4671-8d04-9994875a9f96 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 01 16:45:27.102142 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-9148083f-ad9f-405b-8258-fdbd51f18aaf tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '.version_select at 0x7efd5ea23040>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:27.143623 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-9148083f-ad9f-405b-8258-fdbd51f18aaf tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-375118878" status: 202 len: 0 microversion: 2.1 time: 0.049417 Aug 01 16:45:27.158033 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 414/839] 10.222.0.45 () {58 vars in 1218 bytes} [Mon Aug 1 16:45:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-375118878 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 01 16:45:27.580635 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-190110ef-f598-4e4d-88c3-a29c4a6ff4be tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:27.580635 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-190110ef-f598-4e4d-88c3-a29c4a6ff4be tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:27.595500 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-190110ef-f598-4e4d-88c3-a29c4a6ff4be tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:27.597943 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-190110ef-f598-4e4d-88c3-a29c4a6ff4be tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:27.600396 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-190110ef-f598-4e4d-88c3-a29c4a6ff4be tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:27.603048 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-190110ef-f598-4e4d-88c3-a29c4a6ff4be tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:28.019310 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-190110ef-f598-4e4d-88c3-a29c4a6ff4be tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:28.032757 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-190110ef-f598-4e4d-88c3-a29c4a6ff4be tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:28.036095 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-190110ef-f598-4e4d-88c3-a29c4a6ff4be tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:28.038612 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-190110ef-f598-4e4d-88c3-a29c4a6ff4be tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926" status: 200 len: 1740 microversion: 2.20 time: 0.476902 Aug 01 16:45:28.040209 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 426/840] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:45:27 2022] GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926 => generated 1740 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:45:28.095137 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-dc5a59aa-cab0-4c2a-9278-5e1f85e86c33 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dc718871-e5d7-4058-9602-16e8c398a613"}} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:45:28.097536 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-dc5a59aa-cab0-4c2a-9278-5e1f85e86c33 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 064171b4-a8a9-498c-bbd9-f51ff91afdc7] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:28.115182 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-dc5a59aa-cab0-4c2a-9278-5e1f85e86c33 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:28.116346 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-dc5a59aa-cab0-4c2a-9278-5e1f85e86c33 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:28.117423 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-dc5a59aa-cab0-4c2a-9278-5e1f85e86c33 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:28.118081 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-dc5a59aa-cab0-4c2a-9278-5e1f85e86c33 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:28.577580 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-dc5a59aa-cab0-4c2a-9278-5e1f85e86c33 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "POST /compute/v2.1/servers/064171b4-a8a9-498c-bbd9-f51ff91afdc7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.487322 Aug 01 16:45:28.578901 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 415/841] 10.222.0.45 () {60 vars in 1323 bytes} [Mon Aug 1 16:45:28 2022] POST /compute/v2.1/servers/064171b4-a8a9-498c-bbd9-f51ff91afdc7/os-volume_attachments => generated 194 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:45:29.069563 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-1460a355-3751-4a7a-ab2d-244b53e3bc38 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:29.070555 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-1460a355-3751-4a7a-ab2d-244b53e3bc38 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:29.083382 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-1460a355-3751-4a7a-ab2d-244b53e3bc38 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:29.085340 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-1460a355-3751-4a7a-ab2d-244b53e3bc38 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:29.088055 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-1460a355-3751-4a7a-ab2d-244b53e3bc38 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:29.089404 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-1460a355-3751-4a7a-ab2d-244b53e3bc38 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:29.383336 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-1460a355-3751-4a7a-ab2d-244b53e3bc38 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:29.398268 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-1460a355-3751-4a7a-ab2d-244b53e3bc38 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:29.400197 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-1460a355-3751-4a7a-ab2d-244b53e3bc38 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:29.401591 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-1460a355-3751-4a7a-ab2d-244b53e3bc38 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926" status: 200 len: 1740 microversion: 2.20 time: 0.338500 Aug 01 16:45:29.402644 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 427/842] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:45:29 2022] GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926 => generated 1740 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:45:30.437529 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-674c4897-3772-430b-bdb1-14639903ddb0 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:30.439202 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-674c4897-3772-430b-bdb1-14639903ddb0 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:30.453488 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-674c4897-3772-430b-bdb1-14639903ddb0 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:30.454207 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-674c4897-3772-430b-bdb1-14639903ddb0 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:30.456566 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-674c4897-3772-430b-bdb1-14639903ddb0 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:30.458862 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-674c4897-3772-430b-bdb1-14639903ddb0 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:30.718520 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-674c4897-3772-430b-bdb1-14639903ddb0 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:30.733384 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-674c4897-3772-430b-bdb1-14639903ddb0 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:30.736379 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-674c4897-3772-430b-bdb1-14639903ddb0 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:30.738877 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-674c4897-3772-430b-bdb1-14639903ddb0 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926" status: 200 len: 1740 microversion: 2.20 time: 0.307115 Aug 01 16:45:30.751526 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 416/843] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:45:30 2022] GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926 => generated 1740 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:45:31.300783 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-f061ecf0-a4bb-420a-8c4a-dcedd7c7f8a8 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:31.301985 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-f061ecf0-a4bb-420a-8c4a-dcedd7c7f8a8 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: e2e46d25-15d6-4671-8d04-9994875a9f96] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:31.312067 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-f061ecf0-a4bb-420a-8c4a-dcedd7c7f8a8 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:31.312793 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-f061ecf0-a4bb-420a-8c4a-dcedd7c7f8a8 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:31.313964 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-f061ecf0-a4bb-420a-8c4a-dcedd7c7f8a8 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:31.314571 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-f061ecf0-a4bb-420a-8c4a-dcedd7c7f8a8 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:31.333977 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.wsgi [None req-f061ecf0-a4bb-420a-8c4a-dcedd7c7f8a8 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] HTTP exception thrown: Instance e2e46d25-15d6-4671-8d04-9994875a9f96 could not be found. Aug 01 16:45:31.340847 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-f061ecf0-a4bb-420a-8c4a-dcedd7c7f8a8 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Request method failure captured: Aug 01 16:45:31.340847 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: request: DELETE /compute/v2.1/servers/e2e46d25-15d6-4671-8d04-9994875a9f96 HTTP/1.1 Aug 01 16:45:31.340847 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Accept: application/json Aug 01 16:45:31.340847 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Accept-Encoding: identity Aug 01 16:45:31.340847 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Connection: close Aug 01 16:45:31.340847 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Content-Length: 0 Aug 01 16:45:31.340847 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Content-Type: application/json Aug 01 16:45:31.340847 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Host: 10.222.0.45 Aug 01 16:45:31.340847 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Openstack-System-Scope: None Aug 01 16:45:31.340847 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: User-Agent: python-urllib3/1.26.10 Aug 01 16:45:31.340847 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Auth-Token: gAAAAABi6AGyF0jsgYFh-A6y8l3Cn9YYm_pAkGAEG5bnQ2lr6MMYmVbqcoHdLrdkj9hZOvDEvf13Fnl9l68PRDdoffNcGLU3Am-BrhB1pdShu1fwRtyPe5h2ZeKYs1SoojvhOtT0OwtQA3DtUTyNaoSEKCj_5NgMhJf8Ty6o-I__-y_6ux_RLAg Aug 01 16:45:31.340847 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Domain-Id: None Aug 01 16:45:31.340847 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Domain-Name: None Aug 01 16:45:31.340847 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Identity-Status: Confirmed Aug 01 16:45:31.340847 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Is-Admin-Project: True Aug 01 16:45:31.340847 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Domain-Id: default Aug 01 16:45:31.340847 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Domain-Name: Default Aug 01 16:45:31.340847 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Id: 1b66d46c3e7d42b88f2dbdc01232fb03 Aug 01 16:45:31.340847 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Name: tempest-AttachVolumeTestJSON-231018232 Aug 01 16:45:31.340847 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Role: reader,member Aug 01 16:45:31.340847 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Roles: reader,member Aug 01 16:45:31.343041 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_1b66d46c3e7d42b88f2dbdc01232fb03"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/1b66d46c3e7d42b88f2dbdc01232fb03"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1b66d46c3e7d42b88f2dbdc01232fb03"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1b66d46c3e7d42b88f2dbdc01232fb03"}]}] Aug 01 16:45:31.343041 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant: tempest-AttachVolumeTestJSON-231018232 Aug 01 16:45:31.343041 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant-Id: 1b66d46c3e7d42b88f2dbdc01232fb03 Aug 01 16:45:31.343041 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant-Name: tempest-AttachVolumeTestJSON-231018232 Aug 01 16:45:31.343041 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User: tempest-AttachVolumeTestJSON-231018232-project Aug 01 16:45:31.343041 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Domain-Id: default Aug 01 16:45:31.343041 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Domain-Name: Default Aug 01 16:45:31.343041 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Id: 4b0aed0278344119aae6906f4f52b1e5 Aug 01 16:45:31.343041 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Name: tempest-AttachVolumeTestJSON-231018232-project Aug 01 16:45:31.343041 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: method: > Aug 01 16:45:31.343041 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: exception: Instance e2e46d25-15d6-4671-8d04-9994875a9f96 could not be found. Aug 01 16:45:31.343041 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: action_args: {'id': 'e2e46d25-15d6-4671-8d04-9994875a9f96'} Aug 01 16:45:31.344218 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:45:31.344218 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:45:31.344218 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 16:45:31.344218 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 16:45:31.344218 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 16:45:31.344218 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 16:45:31.344218 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 16:45:31.344218 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 16:45:31.344218 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 16:45:31.344218 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 16:45:31.344218 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2e46d25-15d6-4671-8d04-9994875a9f96 could not be found. Aug 01 16:45:31.344218 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:45:31.344218 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:45:31.344218 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:45:31.344218 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:45:31.344218 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:45:31.344218 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:45:31.344218 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:45:31.344218 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:45:31.344218 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:45:31.345926 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:45:31.345926 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 16:45:31.345926 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 16:45:31.345926 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 16:45:31.345926 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 16:45:31.345926 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 16:45:31.345926 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 16:45:31.345926 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 16:45:31.345926 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:45:31.345926 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2e46d25-15d6-4671-8d04-9994875a9f96 could not be found. Aug 01 16:45:31.345926 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:45:31.345926 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:45:31.345926 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:45:31.345926 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:45:31.345926 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:45:31.345926 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:45:31.345926 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:45:31.345926 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:45:31.345926 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2e46d25-15d6-4671-8d04-9994875a9f96 could not be found. Aug 01 16:45:31.345926 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:45:31.347513 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-f061ecf0-a4bb-420a-8c4a-dcedd7c7f8a8 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Returning 404 to user: Instance e2e46d25-15d6-4671-8d04-9994875a9f96 could not be found. {{(pid=118118) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:45:31.347513 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-f061ecf0-a4bb-420a-8c4a-dcedd7c7f8a8 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "DELETE /compute/v2.1/servers/e2e46d25-15d6-4671-8d04-9994875a9f96" status: 404 len: 111 microversion: 2.1 time: 0.045907 Aug 01 16:45:31.347513 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 428/844] 10.222.0.45 () {58 vars in 1239 bytes} [Mon Aug 1 16:45:31 2022] DELETE /compute/v2.1/servers/e2e46d25-15d6-4671-8d04-9994875a9f96 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 16:45:31.351882 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-ab49759c-8ff0-4ee5-a227-70e111eecd61 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:31.352491 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-ab49759c-8ff0-4ee5-a227-70e111eecd61 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: e2e46d25-15d6-4671-8d04-9994875a9f96] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:31.361072 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-ab49759c-8ff0-4ee5-a227-70e111eecd61 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:31.361536 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-ab49759c-8ff0-4ee5-a227-70e111eecd61 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:31.362491 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-ab49759c-8ff0-4ee5-a227-70e111eecd61 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:31.363186 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-ab49759c-8ff0-4ee5-a227-70e111eecd61 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:31.387654 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.wsgi [None req-ab49759c-8ff0-4ee5-a227-70e111eecd61 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] HTTP exception thrown: Instance e2e46d25-15d6-4671-8d04-9994875a9f96 could not be found. Aug 01 16:45:31.391125 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-ab49759c-8ff0-4ee5-a227-70e111eecd61 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Request method failure captured: Aug 01 16:45:31.391125 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: request: GET /compute/v2.1/servers/e2e46d25-15d6-4671-8d04-9994875a9f96 HTTP/1.1 Aug 01 16:45:31.391125 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Accept: application/json Aug 01 16:45:31.391125 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Accept-Encoding: identity Aug 01 16:45:31.391125 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Connection: close Aug 01 16:45:31.391125 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Content-Length: 0 Aug 01 16:45:31.391125 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Content-Type: application/json Aug 01 16:45:31.391125 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Host: 10.222.0.45 Aug 01 16:45:31.391125 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Openstack-System-Scope: None Aug 01 16:45:31.391125 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: User-Agent: python-urllib3/1.26.10 Aug 01 16:45:31.391125 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Auth-Token: gAAAAABi6AGyF0jsgYFh-A6y8l3Cn9YYm_pAkGAEG5bnQ2lr6MMYmVbqcoHdLrdkj9hZOvDEvf13Fnl9l68PRDdoffNcGLU3Am-BrhB1pdShu1fwRtyPe5h2ZeKYs1SoojvhOtT0OwtQA3DtUTyNaoSEKCj_5NgMhJf8Ty6o-I__-y_6ux_RLAg Aug 01 16:45:31.391125 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Domain-Id: None Aug 01 16:45:31.391125 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Domain-Name: None Aug 01 16:45:31.391125 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Identity-Status: Confirmed Aug 01 16:45:31.391125 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Is-Admin-Project: True Aug 01 16:45:31.391125 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Domain-Id: default Aug 01 16:45:31.391125 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Domain-Name: Default Aug 01 16:45:31.391125 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Id: 1b66d46c3e7d42b88f2dbdc01232fb03 Aug 01 16:45:31.391125 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Name: tempest-AttachVolumeTestJSON-231018232 Aug 01 16:45:31.391125 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Role: reader,member Aug 01 16:45:31.391125 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Roles: reader,member Aug 01 16:45:31.392828 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_1b66d46c3e7d42b88f2dbdc01232fb03"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/1b66d46c3e7d42b88f2dbdc01232fb03"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1b66d46c3e7d42b88f2dbdc01232fb03"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1b66d46c3e7d42b88f2dbdc01232fb03"}]}] Aug 01 16:45:31.392828 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Tenant: tempest-AttachVolumeTestJSON-231018232 Aug 01 16:45:31.392828 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Tenant-Id: 1b66d46c3e7d42b88f2dbdc01232fb03 Aug 01 16:45:31.392828 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Tenant-Name: tempest-AttachVolumeTestJSON-231018232 Aug 01 16:45:31.392828 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User: tempest-AttachVolumeTestJSON-231018232-project Aug 01 16:45:31.392828 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Domain-Id: default Aug 01 16:45:31.392828 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Domain-Name: Default Aug 01 16:45:31.392828 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Id: 4b0aed0278344119aae6906f4f52b1e5 Aug 01 16:45:31.392828 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Name: tempest-AttachVolumeTestJSON-231018232-project Aug 01 16:45:31.392828 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: method: > Aug 01 16:45:31.392828 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: exception: Instance e2e46d25-15d6-4671-8d04-9994875a9f96 could not be found. Aug 01 16:45:31.392828 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: action_args: {'id': 'e2e46d25-15d6-4671-8d04-9994875a9f96'} Aug 01 16:45:31.393742 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:45:31.393742 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:45:31.393742 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 16:45:31.393742 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 16:45:31.393742 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 16:45:31.393742 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 16:45:31.393742 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 16:45:31.393742 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 16:45:31.393742 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 16:45:31.393742 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 16:45:31.393742 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2e46d25-15d6-4671-8d04-9994875a9f96 could not be found. Aug 01 16:45:31.393742 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:45:31.393742 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:45:31.393742 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:45:31.393742 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:45:31.393742 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:45:31.393742 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:45:31.393742 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:45:31.393742 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:45:31.393742 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:45:31.395195 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:45:31.395195 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 16:45:31.395195 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 16:45:31.395195 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 16:45:31.395195 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 16:45:31.395195 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 16:45:31.395195 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:45:31.395195 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2e46d25-15d6-4671-8d04-9994875a9f96 could not be found. Aug 01 16:45:31.395195 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:45:31.395195 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:45:31.395195 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:45:31.395195 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:45:31.395195 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:45:31.395195 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:45:31.395195 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:45:31.395195 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:45:31.395195 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2e46d25-15d6-4671-8d04-9994875a9f96 could not be found. Aug 01 16:45:31.395195 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:45:31.397784 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-ab49759c-8ff0-4ee5-a227-70e111eecd61 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Returning 404 to user: Instance e2e46d25-15d6-4671-8d04-9994875a9f96 could not be found. {{(pid=118117) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:45:31.399531 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-ab49759c-8ff0-4ee5-a227-70e111eecd61 tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/e2e46d25-15d6-4671-8d04-9994875a9f96" status: 404 len: 111 microversion: 2.1 time: 0.051840 Aug 01 16:45:31.403865 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 417/845] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:45:31 2022] GET /compute/v2.1/servers/e2e46d25-15d6-4671-8d04-9994875a9f96 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 16:45:31.771728 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-2fa70403-76ff-4ee4-aa14-cf0811433d0e tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:31.773343 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-2fa70403-76ff-4ee4-aa14-cf0811433d0e tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:31.788026 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-2fa70403-76ff-4ee4-aa14-cf0811433d0e tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:31.793031 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-2fa70403-76ff-4ee4-aa14-cf0811433d0e tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:31.793031 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-2fa70403-76ff-4ee4-aa14-cf0811433d0e tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:31.793031 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-2fa70403-76ff-4ee4-aa14-cf0811433d0e tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:32.098554 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-2fa70403-76ff-4ee4-aa14-cf0811433d0e tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:32.117982 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-2fa70403-76ff-4ee4-aa14-cf0811433d0e tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:32.120700 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-2fa70403-76ff-4ee4-aa14-cf0811433d0e tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:32.122718 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-2fa70403-76ff-4ee4-aa14-cf0811433d0e tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926" status: 200 len: 1740 microversion: 2.20 time: 0.358576 Aug 01 16:45:32.123727 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 429/846] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:45:31 2022] GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926 => generated 1740 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:45:32.628327 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-8c76c782-8a66-4d99-9ed0-dc82b09abdea tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:32.629372 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-8c76c782-8a66-4d99-9ed0-dc82b09abdea tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: a3f6b512-e3cb-4e87-8d82-c64f6f1640db] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:32.643329 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-8c76c782-8a66-4d99-9ed0-dc82b09abdea tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:32.648293 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-8c76c782-8a66-4d99-9ed0-dc82b09abdea tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:32.648293 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-8c76c782-8a66-4d99-9ed0-dc82b09abdea tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:32.648293 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-8c76c782-8a66-4d99-9ed0-dc82b09abdea tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:32.681234 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.wsgi [None req-8c76c782-8a66-4d99-9ed0-dc82b09abdea tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] HTTP exception thrown: Instance a3f6b512-e3cb-4e87-8d82-c64f6f1640db could not be found. Aug 01 16:45:32.684083 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-8c76c782-8a66-4d99-9ed0-dc82b09abdea tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Request method failure captured: Aug 01 16:45:32.684083 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: request: DELETE /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db HTTP/1.1 Aug 01 16:45:32.684083 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Accept: application/json Aug 01 16:45:32.684083 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Accept-Encoding: identity Aug 01 16:45:32.684083 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Connection: close Aug 01 16:45:32.684083 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Content-Length: 0 Aug 01 16:45:32.684083 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Content-Type: application/json Aug 01 16:45:32.684083 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Host: 10.222.0.45 Aug 01 16:45:32.684083 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Openstack-System-Scope: None Aug 01 16:45:32.684083 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: User-Agent: python-urllib3/1.26.10 Aug 01 16:45:32.684083 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Auth-Token: gAAAAABi6AGyF0jsgYFh-A6y8l3Cn9YYm_pAkGAEG5bnQ2lr6MMYmVbqcoHdLrdkj9hZOvDEvf13Fnl9l68PRDdoffNcGLU3Am-BrhB1pdShu1fwRtyPe5h2ZeKYs1SoojvhOtT0OwtQA3DtUTyNaoSEKCj_5NgMhJf8Ty6o-I__-y_6ux_RLAg Aug 01 16:45:32.684083 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Domain-Id: None Aug 01 16:45:32.684083 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Domain-Name: None Aug 01 16:45:32.684083 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Identity-Status: Confirmed Aug 01 16:45:32.684083 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Is-Admin-Project: True Aug 01 16:45:32.684083 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Domain-Id: default Aug 01 16:45:32.684083 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Domain-Name: Default Aug 01 16:45:32.684083 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Id: 1b66d46c3e7d42b88f2dbdc01232fb03 Aug 01 16:45:32.684083 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Name: tempest-AttachVolumeTestJSON-231018232 Aug 01 16:45:32.684083 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Role: reader,member Aug 01 16:45:32.684083 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Roles: reader,member Aug 01 16:45:32.685737 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_1b66d46c3e7d42b88f2dbdc01232fb03"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/1b66d46c3e7d42b88f2dbdc01232fb03"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1b66d46c3e7d42b88f2dbdc01232fb03"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1b66d46c3e7d42b88f2dbdc01232fb03"}]}] Aug 01 16:45:32.685737 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Tenant: tempest-AttachVolumeTestJSON-231018232 Aug 01 16:45:32.685737 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Tenant-Id: 1b66d46c3e7d42b88f2dbdc01232fb03 Aug 01 16:45:32.685737 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Tenant-Name: tempest-AttachVolumeTestJSON-231018232 Aug 01 16:45:32.685737 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User: tempest-AttachVolumeTestJSON-231018232-project Aug 01 16:45:32.685737 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Domain-Id: default Aug 01 16:45:32.685737 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Domain-Name: Default Aug 01 16:45:32.685737 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Id: 4b0aed0278344119aae6906f4f52b1e5 Aug 01 16:45:32.685737 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Name: tempest-AttachVolumeTestJSON-231018232-project Aug 01 16:45:32.685737 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: method: > Aug 01 16:45:32.685737 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: exception: Instance a3f6b512-e3cb-4e87-8d82-c64f6f1640db could not be found. Aug 01 16:45:32.685737 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: action_args: {'id': 'a3f6b512-e3cb-4e87-8d82-c64f6f1640db'} Aug 01 16:45:32.686854 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:45:32.686854 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:45:32.686854 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 16:45:32.686854 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 16:45:32.686854 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 16:45:32.686854 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 16:45:32.686854 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 16:45:32.686854 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 16:45:32.686854 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 16:45:32.686854 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 16:45:32.686854 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3f6b512-e3cb-4e87-8d82-c64f6f1640db could not be found. Aug 01 16:45:32.686854 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:45:32.686854 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:45:32.686854 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:45:32.686854 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:45:32.686854 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:45:32.686854 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:45:32.686854 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:45:32.686854 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:45:32.686854 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:45:32.689610 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:45:32.689610 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 16:45:32.689610 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 16:45:32.689610 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 16:45:32.689610 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 16:45:32.689610 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 16:45:32.689610 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 16:45:32.689610 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 16:45:32.689610 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:45:32.689610 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3f6b512-e3cb-4e87-8d82-c64f6f1640db could not be found. Aug 01 16:45:32.689610 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:45:32.689610 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:45:32.689610 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:45:32.689610 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:45:32.689610 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:45:32.689610 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:45:32.689610 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:45:32.689610 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:45:32.689610 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3f6b512-e3cb-4e87-8d82-c64f6f1640db could not be found. Aug 01 16:45:32.689610 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:45:32.692237 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-8c76c782-8a66-4d99-9ed0-dc82b09abdea tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Returning 404 to user: Instance a3f6b512-e3cb-4e87-8d82-c64f6f1640db could not be found. {{(pid=118117) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:45:32.692237 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-8c76c782-8a66-4d99-9ed0-dc82b09abdea tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "DELETE /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db" status: 404 len: 111 microversion: 2.1 time: 0.065454 Aug 01 16:45:32.692237 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 418/847] 10.222.0.45 () {58 vars in 1239 bytes} [Mon Aug 1 16:45:32 2022] DELETE /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 16:45:32.697679 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-b33ff825-2e43-4bf9-907d-79a7d1b8232b tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:32.698751 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-b33ff825-2e43-4bf9-907d-79a7d1b8232b tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] [instance: a3f6b512-e3cb-4e87-8d82-c64f6f1640db] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:32.710405 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-b33ff825-2e43-4bf9-907d-79a7d1b8232b tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:32.710823 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-b33ff825-2e43-4bf9-907d-79a7d1b8232b tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:32.711629 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-b33ff825-2e43-4bf9-907d-79a7d1b8232b tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:32.712184 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-b33ff825-2e43-4bf9-907d-79a7d1b8232b tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:32.731527 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.wsgi [None req-b33ff825-2e43-4bf9-907d-79a7d1b8232b tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] HTTP exception thrown: Instance a3f6b512-e3cb-4e87-8d82-c64f6f1640db could not be found. Aug 01 16:45:32.733224 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-b33ff825-2e43-4bf9-907d-79a7d1b8232b tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Request method failure captured: Aug 01 16:45:32.733224 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: request: GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db HTTP/1.1 Aug 01 16:45:32.733224 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Accept: application/json Aug 01 16:45:32.733224 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Accept-Encoding: identity Aug 01 16:45:32.733224 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Connection: close Aug 01 16:45:32.733224 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Content-Length: 0 Aug 01 16:45:32.733224 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Content-Type: application/json Aug 01 16:45:32.733224 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Host: 10.222.0.45 Aug 01 16:45:32.733224 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Openstack-System-Scope: None Aug 01 16:45:32.733224 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: User-Agent: python-urllib3/1.26.10 Aug 01 16:45:32.733224 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Auth-Token: gAAAAABi6AGyF0jsgYFh-A6y8l3Cn9YYm_pAkGAEG5bnQ2lr6MMYmVbqcoHdLrdkj9hZOvDEvf13Fnl9l68PRDdoffNcGLU3Am-BrhB1pdShu1fwRtyPe5h2ZeKYs1SoojvhOtT0OwtQA3DtUTyNaoSEKCj_5NgMhJf8Ty6o-I__-y_6ux_RLAg Aug 01 16:45:32.733224 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Domain-Id: None Aug 01 16:45:32.733224 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Domain-Name: None Aug 01 16:45:32.733224 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Identity-Status: Confirmed Aug 01 16:45:32.733224 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Is-Admin-Project: True Aug 01 16:45:32.733224 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Domain-Id: default Aug 01 16:45:32.733224 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Domain-Name: Default Aug 01 16:45:32.733224 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Id: 1b66d46c3e7d42b88f2dbdc01232fb03 Aug 01 16:45:32.733224 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Name: tempest-AttachVolumeTestJSON-231018232 Aug 01 16:45:32.733224 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Role: reader,member Aug 01 16:45:32.733224 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Roles: reader,member Aug 01 16:45:32.736029 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_1b66d46c3e7d42b88f2dbdc01232fb03"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/1b66d46c3e7d42b88f2dbdc01232fb03"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1b66d46c3e7d42b88f2dbdc01232fb03"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/1b66d46c3e7d42b88f2dbdc01232fb03"}]}] Aug 01 16:45:32.736029 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant: tempest-AttachVolumeTestJSON-231018232 Aug 01 16:45:32.736029 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant-Id: 1b66d46c3e7d42b88f2dbdc01232fb03 Aug 01 16:45:32.736029 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant-Name: tempest-AttachVolumeTestJSON-231018232 Aug 01 16:45:32.736029 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User: tempest-AttachVolumeTestJSON-231018232-project Aug 01 16:45:32.736029 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Domain-Id: default Aug 01 16:45:32.736029 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Domain-Name: Default Aug 01 16:45:32.736029 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Id: 4b0aed0278344119aae6906f4f52b1e5 Aug 01 16:45:32.736029 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Name: tempest-AttachVolumeTestJSON-231018232-project Aug 01 16:45:32.736029 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: method: > Aug 01 16:45:32.736029 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: exception: Instance a3f6b512-e3cb-4e87-8d82-c64f6f1640db could not be found. Aug 01 16:45:32.736029 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: action_args: {'id': 'a3f6b512-e3cb-4e87-8d82-c64f6f1640db'} Aug 01 16:45:32.737718 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:45:32.737718 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:45:32.737718 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 16:45:32.737718 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 16:45:32.737718 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 16:45:32.737718 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 16:45:32.737718 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 16:45:32.737718 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 16:45:32.737718 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 16:45:32.737718 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 16:45:32.737718 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3f6b512-e3cb-4e87-8d82-c64f6f1640db could not be found. Aug 01 16:45:32.737718 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:45:32.737718 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:45:32.737718 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:45:32.737718 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:45:32.737718 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:45:32.737718 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:45:32.737718 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:45:32.737718 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:45:32.737718 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:45:32.740651 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:45:32.740651 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 16:45:32.740651 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 16:45:32.740651 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 16:45:32.740651 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 16:45:32.740651 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 16:45:32.740651 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:45:32.740651 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3f6b512-e3cb-4e87-8d82-c64f6f1640db could not be found. Aug 01 16:45:32.740651 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:45:32.740651 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:45:32.740651 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:45:32.740651 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:45:32.740651 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:45:32.740651 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:45:32.740651 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:45:32.740651 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:45:32.740651 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3f6b512-e3cb-4e87-8d82-c64f6f1640db could not be found. Aug 01 16:45:32.740651 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:45:32.743355 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-b33ff825-2e43-4bf9-907d-79a7d1b8232b tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] Returning 404 to user: Instance a3f6b512-e3cb-4e87-8d82-c64f6f1640db could not be found. {{(pid=118118) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:45:32.743355 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-b33ff825-2e43-4bf9-907d-79a7d1b8232b tempest-AttachVolumeTestJSON-231018232 tempest-AttachVolumeTestJSON-231018232-project] 10.222.0.45 "GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db" status: 404 len: 111 microversion: 2.1 time: 0.041775 Aug 01 16:45:32.748321 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 430/848] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:45:32 2022] GET /compute/v2.1/servers/a3f6b512-e3cb-4e87-8d82-c64f6f1640db => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 16:45:33.166670 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-5f521d4a-33ec-46f7-8204-9dcc9998e474 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:33.167298 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-5f521d4a-33ec-46f7-8204-9dcc9998e474 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:33.174565 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-5f521d4a-33ec-46f7-8204-9dcc9998e474 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:33.175071 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-5f521d4a-33ec-46f7-8204-9dcc9998e474 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:33.175998 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-5f521d4a-33ec-46f7-8204-9dcc9998e474 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:33.176436 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-5f521d4a-33ec-46f7-8204-9dcc9998e474 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:33.690274 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-5f521d4a-33ec-46f7-8204-9dcc9998e474 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:33.700544 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-5f521d4a-33ec-46f7-8204-9dcc9998e474 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:33.702509 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-5f521d4a-33ec-46f7-8204-9dcc9998e474 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:33.703690 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-5f521d4a-33ec-46f7-8204-9dcc9998e474 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926" status: 200 len: 1740 microversion: 2.20 time: 0.541543 Aug 01 16:45:33.704456 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 419/849] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:45:33 2022] GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926 => generated 1740 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:45:34.748470 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-c6de7d80-117c-430d-bbf3-b33a70761308 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:34.749765 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-c6de7d80-117c-430d-bbf3-b33a70761308 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:34.762115 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-c6de7d80-117c-430d-bbf3-b33a70761308 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:34.763309 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-c6de7d80-117c-430d-bbf3-b33a70761308 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:34.765113 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-c6de7d80-117c-430d-bbf3-b33a70761308 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:34.766247 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-c6de7d80-117c-430d-bbf3-b33a70761308 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:34.969502 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-c6de7d80-117c-430d-bbf3-b33a70761308 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:34.985884 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-c6de7d80-117c-430d-bbf3-b33a70761308 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:34.988479 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-c6de7d80-117c-430d-bbf3-b33a70761308 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:34.991154 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-c6de7d80-117c-430d-bbf3-b33a70761308 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926" status: 200 len: 1722 microversion: 2.20 time: 0.251405 Aug 01 16:45:34.992454 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 431/850] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:45:34 2022] GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926 => generated 1722 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:45:36.031386 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-c66ac41b-640b-4da8-8cca-f80fd810e8b2 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:36.032116 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-c66ac41b-640b-4da8-8cca-f80fd810e8b2 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:36.035258 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_api:SELECT=51,nova_api:DELETE=1 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:45:36.044076 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-c66ac41b-640b-4da8-8cca-f80fd810e8b2 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:36.044536 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-c66ac41b-640b-4da8-8cca-f80fd810e8b2 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:36.045323 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-c66ac41b-640b-4da8-8cca-f80fd810e8b2 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:36.046183 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-c66ac41b-640b-4da8-8cca-f80fd810e8b2 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:36.394839 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-c66ac41b-640b-4da8-8cca-f80fd810e8b2 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:36.451709 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-c66ac41b-640b-4da8-8cca-f80fd810e8b2 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:36.463276 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-c66ac41b-640b-4da8-8cca-f80fd810e8b2 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:36.479685 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-c66ac41b-640b-4da8-8cca-f80fd810e8b2 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926" status: 200 len: 1722 microversion: 2.20 time: 0.439798 Aug 01 16:45:36.480215 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 420/851] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:45:36 2022] GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926 => generated 1722 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:45:37.494976 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-4ce3651b-599d-4157-b4a7-1eab509b1bb4 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:37.495899 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-4ce3651b-599d-4157-b4a7-1eab509b1bb4 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:37.502885 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-4ce3651b-599d-4157-b4a7-1eab509b1bb4 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:37.503329 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-4ce3651b-599d-4157-b4a7-1eab509b1bb4 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:37.504234 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-4ce3651b-599d-4157-b4a7-1eab509b1bb4 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:37.504862 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-4ce3651b-599d-4157-b4a7-1eab509b1bb4 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:37.839166 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-4ce3651b-599d-4157-b4a7-1eab509b1bb4 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:37.856114 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-4ce3651b-599d-4157-b4a7-1eab509b1bb4 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:37.858331 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-4ce3651b-599d-4157-b4a7-1eab509b1bb4 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:37.860110 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-4ce3651b-599d-4157-b4a7-1eab509b1bb4 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926" status: 200 len: 1665 microversion: 2.20 time: 0.369775 Aug 01 16:45:37.860863 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 432/852] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:45:37 2022] GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926 => generated 1665 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 16:45:37.884557 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-076be522-3727-4352-8214-d31c2dcfe57f tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "95b9d79a-be3b-405d-bcae-75eb6e397cb9"}} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:45:37.887885 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-076be522-3727-4352-8214-d31c2dcfe57f tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:37.896775 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-076be522-3727-4352-8214-d31c2dcfe57f tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:37.897944 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-076be522-3727-4352-8214-d31c2dcfe57f tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:37.899515 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-076be522-3727-4352-8214-d31c2dcfe57f tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:37.900604 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-076be522-3727-4352-8214-d31c2dcfe57f tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:37.952416 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-075e96b6-2afa-4134-a6d3-cec85dd015a9 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:37.952984 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-075e96b6-2afa-4134-a6d3-cec85dd015a9 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 064171b4-a8a9-498c-bbd9-f51ff91afdc7] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:37.960027 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-075e96b6-2afa-4134-a6d3-cec85dd015a9 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:37.960579 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-075e96b6-2afa-4134-a6d3-cec85dd015a9 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:37.961574 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-075e96b6-2afa-4134-a6d3-cec85dd015a9 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:37.962167 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-075e96b6-2afa-4134-a6d3-cec85dd015a9 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:38.105589 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.objects.instance [None req-075e96b6-2afa-4134-a6d3-cec85dd015a9 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lazy-loading 'services' on Instance uuid 064171b4-a8a9-498c-bbd9-f51ff91afdc7 {{(pid=118118) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 16:45:38.109805 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:45:38.223575 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-075e96b6-2afa-4134-a6d3-cec85dd015a9 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "DELETE /compute/v2.1/servers/064171b4-a8a9-498c-bbd9-f51ff91afdc7/os-volume_attachments/dc718871-e5d7-4058-9602-16e8c398a613" status: 202 len: 0 microversion: 2.1 time: 0.276943 Aug 01 16:45:38.224419 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 433/853] 10.222.0.45 () {58 vars in 1416 bytes} [Mon Aug 1 16:45:37 2022] DELETE /compute/v2.1/servers/064171b4-a8a9-498c-bbd9-f51ff91afdc7/os-volume_attachments/dc718871-e5d7-4058-9602-16e8c398a613 => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 16:45:38.247718 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-ef782553-c2df-41a2-a46b-fcabc1bc9c64 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:38.253232 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-ef782553-c2df-41a2-a46b-fcabc1bc9c64 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 064171b4-a8a9-498c-bbd9-f51ff91afdc7] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:38.261751 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-ef782553-c2df-41a2-a46b-fcabc1bc9c64 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:38.262490 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-ef782553-c2df-41a2-a46b-fcabc1bc9c64 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:38.263958 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-ef782553-c2df-41a2-a46b-fcabc1bc9c64 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:38.264396 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-ef782553-c2df-41a2-a46b-fcabc1bc9c64 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:38.332560 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-ef782553-c2df-41a2-a46b-fcabc1bc9c64 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/064171b4-a8a9-498c-bbd9-f51ff91afdc7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100239 Aug 01 16:45:38.335872 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 434/854] 10.222.0.45 () {58 vars in 1302 bytes} [Mon Aug 1 16:45:38 2022] GET /compute/v2.1/servers/064171b4-a8a9-498c-bbd9-f51ff91afdc7/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 16:45:38.360077 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-076be522-3727-4352-8214-d31c2dcfe57f tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "POST /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.478545 Aug 01 16:45:38.362812 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 421/855] 10.222.0.45 () {62 vars in 1364 bytes} [Mon Aug 1 16:45:37 2022] POST /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926/os-volume_attachments => generated 188 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 16:45:38.519717 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-8deaf22a-1e44-4be4-ab9d-98c03a8f65b3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:38.520703 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-8deaf22a-1e44-4be4-ab9d-98c03a8f65b3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:38.531011 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-8deaf22a-1e44-4be4-ab9d-98c03a8f65b3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:38.531459 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-8deaf22a-1e44-4be4-ab9d-98c03a8f65b3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:38.532276 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-8deaf22a-1e44-4be4-ab9d-98c03a8f65b3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:38.532708 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-8deaf22a-1e44-4be4-ab9d-98c03a8f65b3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:38.720054 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [req-05935bf7-415c-46b8-a43b-e4ea45491501 req-a90390b3-a3fb-4bcb-8275-5ec2e569cd27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "144c8e15-97cd-4e0d-9d60-2ba97c26e926", "name": "network-vif-unplugged", "status": "completed", "tag": "4f59fd5b-8ef2-4634-a3a5-063fd9fa3526"}]} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:45:38.740296 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-05935bf7-415c-46b8-a43b-e4ea45491501 req-a90390b3-a3fb-4bcb-8275-5ec2e569cd27 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:38.741584 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-05935bf7-415c-46b8-a43b-e4ea45491501 req-a90390b3-a3fb-4bcb-8275-5ec2e569cd27 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:38.764981 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.compute.server_external_events [req-05935bf7-415c-46b8-a43b-e4ea45491501 req-a90390b3-a3fb-4bcb-8275-5ec2e569cd27 service nova] Unable to find a host for instance 144c8e15-97cd-4e0d-9d60-2ba97c26e926. Dropping event network-vif-unplugged {{(pid=118117) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 01 16:45:38.766279 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [req-05935bf7-415c-46b8-a43b-e4ea45491501 req-a90390b3-a3fb-4bcb-8275-5ec2e569cd27 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.051805 Aug 01 16:45:38.767022 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 422/856] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:45:38 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 54 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 01 16:45:38.903402 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-8deaf22a-1e44-4be4-ab9d-98c03a8f65b3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "DELETE /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926/os-volume_attachments/95b9d79a-be3b-405d-bcae-75eb6e397cb9" status: 202 len: 0 microversion: 2.20 time: 0.387904 Aug 01 16:45:38.905421 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 435/857] 10.222.0.45 () {60 vars in 1457 bytes} [Mon Aug 1 16:45:38 2022] DELETE /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926/os-volume_attachments/95b9d79a-be3b-405d-bcae-75eb6e397cb9 => generated 0 bytes in 391 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 01 16:45:39.063138 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-5f442aa9-01cd-4121-9204-1372119b5f68 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:45:39.064515 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-5f442aa9-01cd-4121-9204-1372119b5f68 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:39.072921 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-5f442aa9-01cd-4121-9204-1372119b5f68 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:39.073431 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-5f442aa9-01cd-4121-9204-1372119b5f68 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:39.074422 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-5f442aa9-01cd-4121-9204-1372119b5f68 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:39.074841 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-5f442aa9-01cd-4121-9204-1372119b5f68 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:39.147690 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-5f442aa9-01cd-4121-9204-1372119b5f68 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118117) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 01 16:45:39.241692 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-5f442aa9-01cd-4121-9204-1372119b5f68 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "POST /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926/action" status: 202 len: 0 microversion: 2.20 time: 0.182766 Aug 01 16:45:39.242686 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 423/858] 10.222.0.45 () {62 vars in 1319 bytes} [Mon Aug 1 16:45:39 2022] POST /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 01 16:45:39.258037 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-bcaacdde-6457-44fa-9f03-0ad66e2aad1c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:39.259091 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-bcaacdde-6457-44fa-9f03-0ad66e2aad1c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:39.269397 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-bcaacdde-6457-44fa-9f03-0ad66e2aad1c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:39.270410 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-bcaacdde-6457-44fa-9f03-0ad66e2aad1c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:39.271983 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-bcaacdde-6457-44fa-9f03-0ad66e2aad1c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:39.273193 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-bcaacdde-6457-44fa-9f03-0ad66e2aad1c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:39.350332 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-450f6d91-1a6d-4bf2-849c-5ad726067dda tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:39.353259 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-450f6d91-1a6d-4bf2-849c-5ad726067dda tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 064171b4-a8a9-498c-bbd9-f51ff91afdc7] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:39.360843 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-450f6d91-1a6d-4bf2-849c-5ad726067dda tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:39.361544 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-450f6d91-1a6d-4bf2-849c-5ad726067dda tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:39.362531 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-450f6d91-1a6d-4bf2-849c-5ad726067dda tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:39.363250 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-450f6d91-1a6d-4bf2-849c-5ad726067dda tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:39.399588 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-450f6d91-1a6d-4bf2-849c-5ad726067dda tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/064171b4-a8a9-498c-bbd9-f51ff91afdc7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054032 Aug 01 16:45:39.400585 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 424/859] 10.222.0.45 () {58 vars in 1302 bytes} [Mon Aug 1 16:45:39 2022] GET /compute/v2.1/servers/064171b4-a8a9-498c-bbd9-f51ff91afdc7/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 01 16:45:39.523405 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-84381d55-3e1d-461b-a64b-83c4114186d2 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:39.524288 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-84381d55-3e1d-461b-a64b-83c4114186d2 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 064171b4-a8a9-498c-bbd9-f51ff91afdc7] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:39.527106 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-bcaacdde-6457-44fa-9f03-0ad66e2aad1c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:39.535342 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-84381d55-3e1d-461b-a64b-83c4114186d2 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:39.536438 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-84381d55-3e1d-461b-a64b-83c4114186d2 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:39.539173 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-84381d55-3e1d-461b-a64b-83c4114186d2 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:39.540110 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-84381d55-3e1d-461b-a64b-83c4114186d2 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:39.541146 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-bcaacdde-6457-44fa-9f03-0ad66e2aad1c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:39.543128 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-bcaacdde-6457-44fa-9f03-0ad66e2aad1c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:39.546005 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-bcaacdde-6457-44fa-9f03-0ad66e2aad1c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926" status: 200 len: 1673 microversion: 2.20 time: 0.298129 Aug 01 16:45:39.547625 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 436/860] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:45:39 2022] GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926 => generated 1673 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 16:45:39.595836 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-84381d55-3e1d-461b-a64b-83c4114186d2 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 064171b4-a8a9-498c-bbd9-f51ff91afdc7] Going to try to terminate instance {{(pid=118117) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 16:45:39.726981 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-84381d55-3e1d-461b-a64b-83c4114186d2 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "DELETE /compute/v2.1/servers/064171b4-a8a9-498c-bbd9-f51ff91afdc7" status: 204 len: 0 microversion: 2.1 time: 0.213159 Aug 01 16:45:39.731126 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 425/861] 10.222.0.45 () {58 vars in 1239 bytes} [Mon Aug 1 16:45:39 2022] DELETE /compute/v2.1/servers/064171b4-a8a9-498c-bbd9-f51ff91afdc7 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 16:45:39.736411 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-55d426b6-bc88-435d-bce5-d87c173fc3ee tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:39.737028 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-55d426b6-bc88-435d-bce5-d87c173fc3ee tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 064171b4-a8a9-498c-bbd9-f51ff91afdc7] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:39.743680 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-55d426b6-bc88-435d-bce5-d87c173fc3ee tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:39.744143 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-55d426b6-bc88-435d-bce5-d87c173fc3ee tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:39.744945 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-55d426b6-bc88-435d-bce5-d87c173fc3ee tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:39.745382 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-55d426b6-bc88-435d-bce5-d87c173fc3ee tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:39.967006 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-55d426b6-bc88-435d-bce5-d87c173fc3ee tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac7d3acf1204a9f98f9ee14c2b46a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f46e472f8614c5e847ceb225cc9bff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:39.976697 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-55d426b6-bc88-435d-bce5-d87c173fc3ee tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/064171b4-a8a9-498c-bbd9-f51ff91afdc7" status: 200 len: 1681 microversion: 2.1 time: 0.244145 Aug 01 16:45:39.977278 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 437/862] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:45:39 2022] GET /compute/v2.1/servers/064171b4-a8a9-498c-bbd9-f51ff91afdc7 => generated 1681 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:45:40.587070 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-1606b3ec-2ebe-4fa1-be77-c8411b177b12 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:40.587755 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-1606b3ec-2ebe-4fa1-be77-c8411b177b12 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:40.595230 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-1606b3ec-2ebe-4fa1-be77-c8411b177b12 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:40.595675 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-1606b3ec-2ebe-4fa1-be77-c8411b177b12 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:40.596470 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-1606b3ec-2ebe-4fa1-be77-c8411b177b12 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:40.596890 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-1606b3ec-2ebe-4fa1-be77-c8411b177b12 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:40.735832 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-1606b3ec-2ebe-4fa1-be77-c8411b177b12 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:40.738196 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=8,nova_cell1:INSERT=6 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:45:40.746163 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-1606b3ec-2ebe-4fa1-be77-c8411b177b12 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:40.747676 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-1606b3ec-2ebe-4fa1-be77-c8411b177b12 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:40.748884 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-1606b3ec-2ebe-4fa1-be77-c8411b177b12 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926" status: 200 len: 1673 microversion: 2.20 time: 0.166495 Aug 01 16:45:40.749461 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 426/863] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:45:40 2022] GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926 => generated 1673 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:45:40.998991 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-3dddac62-7259-4999-9ec2-d5bd99e78209 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:41.000112 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-3dddac62-7259-4999-9ec2-d5bd99e78209 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 064171b4-a8a9-498c-bbd9-f51ff91afdc7] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:41.008243 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3dddac62-7259-4999-9ec2-d5bd99e78209 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:41.008850 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3dddac62-7259-4999-9ec2-d5bd99e78209 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:41.009727 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3dddac62-7259-4999-9ec2-d5bd99e78209 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:41.010326 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3dddac62-7259-4999-9ec2-d5bd99e78209 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:41.159926 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-3dddac62-7259-4999-9ec2-d5bd99e78209 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac7d3acf1204a9f98f9ee14c2b46a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f46e472f8614c5e847ceb225cc9bff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:41.169794 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-3dddac62-7259-4999-9ec2-d5bd99e78209 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/064171b4-a8a9-498c-bbd9-f51ff91afdc7" status: 200 len: 1681 microversion: 2.1 time: 0.174992 Aug 01 16:45:41.170380 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 438/864] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:45:40 2022] GET /compute/v2.1/servers/064171b4-a8a9-498c-bbd9-f51ff91afdc7 => generated 1681 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:45:41.772879 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-6c6099d0-77a0-405c-a6b2-ac7e517a7ea3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:41.773473 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-6c6099d0-77a0-405c-a6b2-ac7e517a7ea3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:41.781604 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-6c6099d0-77a0-405c-a6b2-ac7e517a7ea3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:41.782043 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-6c6099d0-77a0-405c-a6b2-ac7e517a7ea3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:41.783096 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-6c6099d0-77a0-405c-a6b2-ac7e517a7ea3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:41.783265 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-6c6099d0-77a0-405c-a6b2-ac7e517a7ea3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:41.941203 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-6c6099d0-77a0-405c-a6b2-ac7e517a7ea3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:41.953224 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-6c6099d0-77a0-405c-a6b2-ac7e517a7ea3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:41.954804 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-6c6099d0-77a0-405c-a6b2-ac7e517a7ea3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:41.956113 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-6c6099d0-77a0-405c-a6b2-ac7e517a7ea3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926" status: 200 len: 1673 microversion: 2.20 time: 0.187235 Aug 01 16:45:41.956696 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 427/865] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:45:41 2022] GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926 => generated 1673 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:45:42.192302 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-8b445579-641f-4627-90c7-ab3bc0b3bfbb tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:42.192970 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-8b445579-641f-4627-90c7-ab3bc0b3bfbb tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 064171b4-a8a9-498c-bbd9-f51ff91afdc7] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:42.200970 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-8b445579-641f-4627-90c7-ab3bc0b3bfbb tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:42.201412 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-8b445579-641f-4627-90c7-ab3bc0b3bfbb tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:42.202177 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-8b445579-641f-4627-90c7-ab3bc0b3bfbb tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:42.202633 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-8b445579-641f-4627-90c7-ab3bc0b3bfbb tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:42.424240 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-8b445579-641f-4627-90c7-ab3bc0b3bfbb tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac7d3acf1204a9f98f9ee14c2b46a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f46e472f8614c5e847ceb225cc9bff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:42.438056 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-8b445579-641f-4627-90c7-ab3bc0b3bfbb tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/064171b4-a8a9-498c-bbd9-f51ff91afdc7" status: 200 len: 1681 microversion: 2.1 time: 0.249224 Aug 01 16:45:42.439143 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 439/866] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:45:42 2022] GET /compute/v2.1/servers/064171b4-a8a9-498c-bbd9-f51ff91afdc7 => generated 1681 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:45:42.980950 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-22df8de9-fc33-49ab-83b2-d55b0b1b3da8 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:42.981541 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-22df8de9-fc33-49ab-83b2-d55b0b1b3da8 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:42.990305 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-22df8de9-fc33-49ab-83b2-d55b0b1b3da8 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:42.990756 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-22df8de9-fc33-49ab-83b2-d55b0b1b3da8 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:42.991544 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-22df8de9-fc33-49ab-83b2-d55b0b1b3da8 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:42.992017 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-22df8de9-fc33-49ab-83b2-d55b0b1b3da8 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:43.178655 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-22df8de9-fc33-49ab-83b2-d55b0b1b3da8 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:43.188714 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-22df8de9-fc33-49ab-83b2-d55b0b1b3da8 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:43.190312 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-22df8de9-fc33-49ab-83b2-d55b0b1b3da8 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:43.191959 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-22df8de9-fc33-49ab-83b2-d55b0b1b3da8 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926" status: 200 len: 1673 microversion: 2.20 time: 0.214978 Aug 01 16:45:43.192773 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 428/867] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:45:42 2022] GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926 => generated 1673 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:45:43.471846 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-58cb4198-67f7-4e25-af80-888ef8a90182 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:43.472515 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-58cb4198-67f7-4e25-af80-888ef8a90182 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 064171b4-a8a9-498c-bbd9-f51ff91afdc7] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:43.481819 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-58cb4198-67f7-4e25-af80-888ef8a90182 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:43.482714 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-58cb4198-67f7-4e25-af80-888ef8a90182 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:43.484159 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-58cb4198-67f7-4e25-af80-888ef8a90182 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:43.485220 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-58cb4198-67f7-4e25-af80-888ef8a90182 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:43.633836 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-58cb4198-67f7-4e25-af80-888ef8a90182 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac7d3acf1204a9f98f9ee14c2b46a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f46e472f8614c5e847ceb225cc9bff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:43.645185 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-58cb4198-67f7-4e25-af80-888ef8a90182 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/064171b4-a8a9-498c-bbd9-f51ff91afdc7" status: 200 len: 1681 microversion: 2.1 time: 0.177825 Aug 01 16:45:43.645811 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 440/868] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:45:43 2022] GET /compute/v2.1/servers/064171b4-a8a9-498c-bbd9-f51ff91afdc7 => generated 1681 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:45:44.219466 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-1e2e0c85-c7c9-494e-822a-18445e9f5242 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:44.220625 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-1e2e0c85-c7c9-494e-822a-18445e9f5242 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:44.228716 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-1e2e0c85-c7c9-494e-822a-18445e9f5242 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:44.229163 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-1e2e0c85-c7c9-494e-822a-18445e9f5242 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:44.230070 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-1e2e0c85-c7c9-494e-822a-18445e9f5242 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:44.230566 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-1e2e0c85-c7c9-494e-822a-18445e9f5242 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:44.406200 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-1e2e0c85-c7c9-494e-822a-18445e9f5242 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:44.421197 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-1e2e0c85-c7c9-494e-822a-18445e9f5242 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:44.422661 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-1e2e0c85-c7c9-494e-822a-18445e9f5242 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:44.423887 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-1e2e0c85-c7c9-494e-822a-18445e9f5242 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926" status: 200 len: 1675 microversion: 2.20 time: 0.209076 Aug 01 16:45:44.424659 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 429/869] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:45:44 2022] GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926 => generated 1675 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:45:44.667187 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-62597235-ce5d-4b3d-adaa-f5de4a52d61b tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:44.668065 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-62597235-ce5d-4b3d-adaa-f5de4a52d61b tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 064171b4-a8a9-498c-bbd9-f51ff91afdc7] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:44.676033 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-62597235-ce5d-4b3d-adaa-f5de4a52d61b tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:44.676543 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-62597235-ce5d-4b3d-adaa-f5de4a52d61b tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:44.677383 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-62597235-ce5d-4b3d-adaa-f5de4a52d61b tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:44.677953 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-62597235-ce5d-4b3d-adaa-f5de4a52d61b tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:44.836377 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-62597235-ce5d-4b3d-adaa-f5de4a52d61b tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac7d3acf1204a9f98f9ee14c2b46a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f46e472f8614c5e847ceb225cc9bff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:44.845385 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-62597235-ce5d-4b3d-adaa-f5de4a52d61b tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/064171b4-a8a9-498c-bbd9-f51ff91afdc7" status: 200 len: 1681 microversion: 2.1 time: 0.182182 Aug 01 16:45:44.845974 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 441/870] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:45:44 2022] GET /compute/v2.1/servers/064171b4-a8a9-498c-bbd9-f51ff91afdc7 => generated 1681 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:45:45.448466 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-9a153167-1168-4c45-bec6-a8a57719796f tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:45.449737 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-9a153167-1168-4c45-bec6-a8a57719796f tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:45.456412 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-9a153167-1168-4c45-bec6-a8a57719796f tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:45.456854 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-9a153167-1168-4c45-bec6-a8a57719796f tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:45.457632 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-9a153167-1168-4c45-bec6-a8a57719796f tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:45.458059 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-9a153167-1168-4c45-bec6-a8a57719796f tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:45.613822 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-9a153167-1168-4c45-bec6-a8a57719796f tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:45.622524 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-9a153167-1168-4c45-bec6-a8a57719796f tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:45.624059 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-9a153167-1168-4c45-bec6-a8a57719796f tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:45.625259 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-9a153167-1168-4c45-bec6-a8a57719796f tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926" status: 200 len: 1675 microversion: 2.20 time: 0.180725 Aug 01 16:45:45.625817 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 430/871] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:45:45 2022] GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926 => generated 1675 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:45:45.869115 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-ed8978d4-ec8e-4a5b-8b40-cdb6e535364f tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:45.871296 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-ed8978d4-ec8e-4a5b-8b40-cdb6e535364f tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 064171b4-a8a9-498c-bbd9-f51ff91afdc7] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:45.883918 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-ed8978d4-ec8e-4a5b-8b40-cdb6e535364f tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:45.885115 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-ed8978d4-ec8e-4a5b-8b40-cdb6e535364f tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:45.886604 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-ed8978d4-ec8e-4a5b-8b40-cdb6e535364f tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:45.887604 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-ed8978d4-ec8e-4a5b-8b40-cdb6e535364f tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:46.270170 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-ed8978d4-ec8e-4a5b-8b40-cdb6e535364f tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac7d3acf1204a9f98f9ee14c2b46a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f46e472f8614c5e847ceb225cc9bff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:46.287029 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-ed8978d4-ec8e-4a5b-8b40-cdb6e535364f tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/064171b4-a8a9-498c-bbd9-f51ff91afdc7" status: 200 len: 1681 microversion: 2.1 time: 0.421980 Aug 01 16:45:46.291196 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 442/872] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:45:45 2022] GET /compute/v2.1/servers/064171b4-a8a9-498c-bbd9-f51ff91afdc7 => generated 1681 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:45:46.655044 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-05b3eba0-d4d1-4013-b07c-ef1a56a2bba3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:46.656193 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-05b3eba0-d4d1-4013-b07c-ef1a56a2bba3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:46.678355 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-05b3eba0-d4d1-4013-b07c-ef1a56a2bba3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:46.684399 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-05b3eba0-d4d1-4013-b07c-ef1a56a2bba3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:46.686367 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-05b3eba0-d4d1-4013-b07c-ef1a56a2bba3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:46.687159 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-05b3eba0-d4d1-4013-b07c-ef1a56a2bba3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:46.979471 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-05b3eba0-d4d1-4013-b07c-ef1a56a2bba3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:46.993630 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-05b3eba0-d4d1-4013-b07c-ef1a56a2bba3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:46.996448 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-05b3eba0-d4d1-4013-b07c-ef1a56a2bba3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:46.998884 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-05b3eba0-d4d1-4013-b07c-ef1a56a2bba3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926" status: 200 len: 1731 microversion: 2.20 time: 0.350849 Aug 01 16:45:46.999556 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 431/873] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:45:46 2022] GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926 => generated 1731 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:45:47.233425 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [req-72e8abcc-0004-447a-8279-9741b60feb75 req-a61c5670-0c27-449d-8317-776d6ca956dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "064171b4-a8a9-498c-bbd9-f51ff91afdc7", "name": "network-vif-deleted", "tag": "a331a8b4-f92d-457c-aef9-7ba33b18d041"}]} {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:45:47.267990 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-72e8abcc-0004-447a-8279-9741b60feb75 req-a61c5670-0c27-449d-8317-776d6ca956dc service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:47.268864 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-72e8abcc-0004-447a-8279-9741b60feb75 req-a61c5670-0c27-449d-8317-776d6ca956dc service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:47.313909 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-2de4290f-352e-49ac-821a-39f6e43b9240 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:47.314786 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-2de4290f-352e-49ac-821a-39f6e43b9240 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 064171b4-a8a9-498c-bbd9-f51ff91afdc7] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:47.325753 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-2de4290f-352e-49ac-821a-39f6e43b9240 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:47.328980 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-2de4290f-352e-49ac-821a-39f6e43b9240 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:47.329991 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-2de4290f-352e-49ac-821a-39f6e43b9240 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:47.331879 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-2de4290f-352e-49ac-821a-39f6e43b9240 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:47.353199 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.compute.server_external_events [req-72e8abcc-0004-447a-8279-9741b60feb75 req-a61c5670-0c27-449d-8317-776d6ca956dc service nova] Creating event network-vif-deleted:a331a8b4-f92d-457c-aef9-7ba33b18d041 for instance 064171b4-a8a9-498c-bbd9-f51ff91afdc7 on hv-cinder-85032 Aug 01 16:45:47.369005 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [req-72e8abcc-0004-447a-8279-9741b60feb75 req-a61c5670-0c27-449d-8317-776d6ca956dc service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142414 Aug 01 16:45:47.369603 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 443/874] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:45:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 16:45:47.520867 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-2de4290f-352e-49ac-821a-39f6e43b9240 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ac7d3acf1204a9f98f9ee14c2b46a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f46e472f8614c5e847ceb225cc9bff1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:47.530919 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-2de4290f-352e-49ac-821a-39f6e43b9240 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/064171b4-a8a9-498c-bbd9-f51ff91afdc7" status: 200 len: 1326 microversion: 2.1 time: 0.221929 Aug 01 16:45:47.532286 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 432/875] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:45:47 2022] GET /compute/v2.1/servers/064171b4-a8a9-498c-bbd9-f51ff91afdc7 => generated 1326 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:45:48.061120 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-65876e72-73ab-4a8d-8cff-c296dafb8b40 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:48.071025 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-65876e72-73ab-4a8d-8cff-c296dafb8b40 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:48.109598 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-65876e72-73ab-4a8d-8cff-c296dafb8b40 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:48.119904 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-65876e72-73ab-4a8d-8cff-c296dafb8b40 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:48.124155 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-65876e72-73ab-4a8d-8cff-c296dafb8b40 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:48.125746 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-65876e72-73ab-4a8d-8cff-c296dafb8b40 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:48.500500 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-65876e72-73ab-4a8d-8cff-c296dafb8b40 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:48.517242 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-65876e72-73ab-4a8d-8cff-c296dafb8b40 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:48.525149 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-65876e72-73ab-4a8d-8cff-c296dafb8b40 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:48.528499 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-65876e72-73ab-4a8d-8cff-c296dafb8b40 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926" status: 200 len: 1731 microversion: 2.20 time: 0.504932 Aug 01 16:45:48.529398 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 444/876] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:45:48 2022] GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926 => generated 1731 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:45:48.560331 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-8a26c1b8-994d-4154-b6a3-05def34b343c tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:48.563009 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-8a26c1b8-994d-4154-b6a3-05def34b343c tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 064171b4-a8a9-498c-bbd9-f51ff91afdc7] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:48.583335 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-8a26c1b8-994d-4154-b6a3-05def34b343c tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:48.584230 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-8a26c1b8-994d-4154-b6a3-05def34b343c tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:48.587056 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-8a26c1b8-994d-4154-b6a3-05def34b343c tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:48.589142 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-8a26c1b8-994d-4154-b6a3-05def34b343c tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:48.627573 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.wsgi [None req-8a26c1b8-994d-4154-b6a3-05def34b343c tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] HTTP exception thrown: Instance 064171b4-a8a9-498c-bbd9-f51ff91afdc7 could not be found. Aug 01 16:45:48.632511 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-8a26c1b8-994d-4154-b6a3-05def34b343c tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Request method failure captured: Aug 01 16:45:48.632511 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: request: GET /compute/v2.1/servers/064171b4-a8a9-498c-bbd9-f51ff91afdc7 HTTP/1.1 Aug 01 16:45:48.632511 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Accept: application/json Aug 01 16:45:48.632511 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Accept-Encoding: identity Aug 01 16:45:48.632511 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Connection: close Aug 01 16:45:48.632511 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Content-Length: 0 Aug 01 16:45:48.632511 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Content-Type: application/json Aug 01 16:45:48.632511 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Host: 10.222.0.45 Aug 01 16:45:48.632511 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Openstack-System-Scope: None Aug 01 16:45:48.632511 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: User-Agent: python-urllib3/1.26.10 Aug 01 16:45:48.632511 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Auth-Token: gAAAAABi6AHCRDGoebg0LS7gmy1eTpjTuQd112Y1pcMjujKk6txGUWSA3OMMaHc1baNi_AdoDEvdhzRnASCOKOmNH90_reDUi0PqBGMG7mNlkYUDBNxMpR2mUAgvvel08FXbCsasfVUCgx1es__sgSc1ixE0JQKf1ZzhFBiBb0upY90FvmppuN0 Aug 01 16:45:48.632511 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Domain-Id: None Aug 01 16:45:48.632511 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Domain-Name: None Aug 01 16:45:48.632511 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Identity-Status: Confirmed Aug 01 16:45:48.632511 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Is-Admin-Project: True Aug 01 16:45:48.632511 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Domain-Id: default Aug 01 16:45:48.632511 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Domain-Name: Default Aug 01 16:45:48.632511 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Id: 2f46e472f8614c5e847ceb225cc9bff1 Aug 01 16:45:48.632511 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Name: tempest-AttachVolumeNegativeTest-597514302 Aug 01 16:45:48.632511 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Role: reader,member Aug 01 16:45:48.632511 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Roles: reader,member Aug 01 16:45:48.634745 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2f46e472f8614c5e847ceb225cc9bff1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2f46e472f8614c5e847ceb225cc9bff1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2f46e472f8614c5e847ceb225cc9bff1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2f46e472f8614c5e847ceb225cc9bff1"}]}] Aug 01 16:45:48.634745 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Tenant: tempest-AttachVolumeNegativeTest-597514302 Aug 01 16:45:48.634745 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Tenant-Id: 2f46e472f8614c5e847ceb225cc9bff1 Aug 01 16:45:48.634745 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-597514302 Aug 01 16:45:48.634745 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User: tempest-AttachVolumeNegativeTest-597514302-project Aug 01 16:45:48.634745 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Domain-Id: default Aug 01 16:45:48.634745 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Domain-Name: Default Aug 01 16:45:48.634745 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Id: 1ac7d3acf1204a9f98f9ee14c2b46a5e Aug 01 16:45:48.634745 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Name: tempest-AttachVolumeNegativeTest-597514302-project Aug 01 16:45:48.634745 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: method: > Aug 01 16:45:48.634745 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: exception: Instance 064171b4-a8a9-498c-bbd9-f51ff91afdc7 could not be found. Aug 01 16:45:48.634745 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: action_args: {'id': '064171b4-a8a9-498c-bbd9-f51ff91afdc7'} Aug 01 16:45:48.636011 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:45:48.636011 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:45:48.636011 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 16:45:48.636011 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 16:45:48.636011 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 16:45:48.636011 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 16:45:48.636011 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 16:45:48.636011 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 16:45:48.636011 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 16:45:48.636011 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 16:45:48.636011 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 064171b4-a8a9-498c-bbd9-f51ff91afdc7 could not be found. Aug 01 16:45:48.636011 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:45:48.636011 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:45:48.636011 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:45:48.636011 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:45:48.636011 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:45:48.636011 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:45:48.636011 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:45:48.636011 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:45:48.636011 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:45:48.637845 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:45:48.637845 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 16:45:48.637845 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 16:45:48.637845 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 16:45:48.637845 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 16:45:48.637845 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 16:45:48.637845 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:45:48.637845 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 064171b4-a8a9-498c-bbd9-f51ff91afdc7 could not be found. Aug 01 16:45:48.637845 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:45:48.637845 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:45:48.637845 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:45:48.637845 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:45:48.637845 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:45:48.637845 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:45:48.637845 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:45:48.637845 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:45:48.637845 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 064171b4-a8a9-498c-bbd9-f51ff91afdc7 could not be found. Aug 01 16:45:48.637845 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:45:48.641378 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-8a26c1b8-994d-4154-b6a3-05def34b343c tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Returning 404 to user: Instance 064171b4-a8a9-498c-bbd9-f51ff91afdc7 could not be found. {{(pid=118117) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:45:48.641378 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-8a26c1b8-994d-4154-b6a3-05def34b343c tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/064171b4-a8a9-498c-bbd9-f51ff91afdc7" status: 404 len: 111 microversion: 2.1 time: 0.084268 Aug 01 16:45:48.656488 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 433/877] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:45:48 2022] GET /compute/v2.1/servers/064171b4-a8a9-498c-bbd9-f51ff91afdc7 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 16:45:48.657536 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-e614c4e8-ae23-4452-9ccb-98aeb7709c2e tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '.version_select at 0x7efd67453af0>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:48.712764 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-e614c4e8-ae23-4452-9ccb-98aeb7709c2e tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-902399961" status: 202 len: 0 microversion: 2.1 time: 0.066988 Aug 01 16:45:48.716363 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 445/878] 10.222.0.45 () {58 vars in 1218 bytes} [Mon Aug 1 16:45:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-902399961 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 16:45:49.595836 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-e7b459d1-8e7d-402b-bd2f-077254ff10a3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:49.601419 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-e7b459d1-8e7d-402b-bd2f-077254ff10a3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:49.620581 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-e7b459d1-8e7d-402b-bd2f-077254ff10a3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:49.621919 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-e7b459d1-8e7d-402b-bd2f-077254ff10a3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:49.624346 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-e7b459d1-8e7d-402b-bd2f-077254ff10a3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:49.625663 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-e7b459d1-8e7d-402b-bd2f-077254ff10a3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:49.942643 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-e7b459d1-8e7d-402b-bd2f-077254ff10a3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:49.974878 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-e7b459d1-8e7d-402b-bd2f-077254ff10a3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:49.976381 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-e7b459d1-8e7d-402b-bd2f-077254ff10a3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:49.977943 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-e7b459d1-8e7d-402b-bd2f-077254ff10a3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926" status: 200 len: 1731 microversion: 2.20 time: 0.413359 Aug 01 16:45:49.992797 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 434/879] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:45:49 2022] GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926 => generated 1731 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:45:51.014914 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-4a583bd4-c60f-44e7-ae88-2f055ea38d46 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:51.017295 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-4a583bd4-c60f-44e7-ae88-2f055ea38d46 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:51.032291 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-4a583bd4-c60f-44e7-ae88-2f055ea38d46 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:51.033742 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-4a583bd4-c60f-44e7-ae88-2f055ea38d46 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:51.036301 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-4a583bd4-c60f-44e7-ae88-2f055ea38d46 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:51.037935 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-4a583bd4-c60f-44e7-ae88-2f055ea38d46 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:51.382423 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-4a583bd4-c60f-44e7-ae88-2f055ea38d46 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:51.398942 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-4a583bd4-c60f-44e7-ae88-2f055ea38d46 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:51.402185 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-4a583bd4-c60f-44e7-ae88-2f055ea38d46 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:51.404426 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-4a583bd4-c60f-44e7-ae88-2f055ea38d46 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926" status: 200 len: 1731 microversion: 2.20 time: 0.399624 Aug 01 16:45:51.405634 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 446/880] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:45:51 2022] GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926 => generated 1731 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:45:51.709243 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-6940c4e9-78d0-4f61-a607-b983c25bb77a tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:51.711363 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-6940c4e9-78d0-4f61-a607-b983c25bb77a tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 064171b4-a8a9-498c-bbd9-f51ff91afdc7] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:51.732712 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-6940c4e9-78d0-4f61-a607-b983c25bb77a tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:51.735929 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-6940c4e9-78d0-4f61-a607-b983c25bb77a tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:51.737808 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-6940c4e9-78d0-4f61-a607-b983c25bb77a tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:51.738795 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-6940c4e9-78d0-4f61-a607-b983c25bb77a tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:51.772689 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.wsgi [None req-6940c4e9-78d0-4f61-a607-b983c25bb77a tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] HTTP exception thrown: Instance 064171b4-a8a9-498c-bbd9-f51ff91afdc7 could not be found. Aug 01 16:45:51.776151 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-6940c4e9-78d0-4f61-a607-b983c25bb77a tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Request method failure captured: Aug 01 16:45:51.776151 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: request: DELETE /compute/v2.1/servers/064171b4-a8a9-498c-bbd9-f51ff91afdc7 HTTP/1.1 Aug 01 16:45:51.776151 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Accept: application/json Aug 01 16:45:51.776151 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Accept-Encoding: identity Aug 01 16:45:51.776151 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Connection: close Aug 01 16:45:51.776151 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Content-Length: 0 Aug 01 16:45:51.776151 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Content-Type: application/json Aug 01 16:45:51.776151 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Host: 10.222.0.45 Aug 01 16:45:51.776151 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Openstack-System-Scope: None Aug 01 16:45:51.776151 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: User-Agent: python-urllib3/1.26.10 Aug 01 16:45:51.776151 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Auth-Token: gAAAAABi6AHCRDGoebg0LS7gmy1eTpjTuQd112Y1pcMjujKk6txGUWSA3OMMaHc1baNi_AdoDEvdhzRnASCOKOmNH90_reDUi0PqBGMG7mNlkYUDBNxMpR2mUAgvvel08FXbCsasfVUCgx1es__sgSc1ixE0JQKf1ZzhFBiBb0upY90FvmppuN0 Aug 01 16:45:51.776151 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Domain-Id: None Aug 01 16:45:51.776151 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Domain-Name: None Aug 01 16:45:51.776151 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Identity-Status: Confirmed Aug 01 16:45:51.776151 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Is-Admin-Project: True Aug 01 16:45:51.776151 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Domain-Id: default Aug 01 16:45:51.776151 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Domain-Name: Default Aug 01 16:45:51.776151 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Id: 2f46e472f8614c5e847ceb225cc9bff1 Aug 01 16:45:51.776151 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Name: tempest-AttachVolumeNegativeTest-597514302 Aug 01 16:45:51.776151 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Role: reader,member Aug 01 16:45:51.776151 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Roles: reader,member Aug 01 16:45:51.779386 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2f46e472f8614c5e847ceb225cc9bff1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2f46e472f8614c5e847ceb225cc9bff1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2f46e472f8614c5e847ceb225cc9bff1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2f46e472f8614c5e847ceb225cc9bff1"}]}] Aug 01 16:45:51.779386 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Tenant: tempest-AttachVolumeNegativeTest-597514302 Aug 01 16:45:51.779386 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Tenant-Id: 2f46e472f8614c5e847ceb225cc9bff1 Aug 01 16:45:51.779386 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-597514302 Aug 01 16:45:51.779386 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User: tempest-AttachVolumeNegativeTest-597514302-project Aug 01 16:45:51.779386 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Domain-Id: default Aug 01 16:45:51.779386 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Domain-Name: Default Aug 01 16:45:51.779386 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Id: 1ac7d3acf1204a9f98f9ee14c2b46a5e Aug 01 16:45:51.779386 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Name: tempest-AttachVolumeNegativeTest-597514302-project Aug 01 16:45:51.779386 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: method: > Aug 01 16:45:51.779386 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: exception: Instance 064171b4-a8a9-498c-bbd9-f51ff91afdc7 could not be found. Aug 01 16:45:51.779386 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: action_args: {'id': '064171b4-a8a9-498c-bbd9-f51ff91afdc7'} Aug 01 16:45:51.781121 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:45:51.781121 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:45:51.781121 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 16:45:51.781121 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 16:45:51.781121 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 16:45:51.781121 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 16:45:51.781121 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 16:45:51.781121 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 16:45:51.781121 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 16:45:51.781121 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 16:45:51.781121 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 064171b4-a8a9-498c-bbd9-f51ff91afdc7 could not be found. Aug 01 16:45:51.781121 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:45:51.781121 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:45:51.781121 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:45:51.781121 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:45:51.781121 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:45:51.781121 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:45:51.781121 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:45:51.781121 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:45:51.781121 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:45:51.784219 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:45:51.784219 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 16:45:51.784219 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 16:45:51.784219 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 16:45:51.784219 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 16:45:51.784219 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 16:45:51.784219 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 16:45:51.784219 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 16:45:51.784219 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:45:51.784219 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 064171b4-a8a9-498c-bbd9-f51ff91afdc7 could not be found. Aug 01 16:45:51.784219 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:45:51.784219 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:45:51.784219 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:45:51.784219 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:45:51.784219 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:45:51.784219 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:45:51.784219 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:45:51.784219 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:45:51.784219 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 064171b4-a8a9-498c-bbd9-f51ff91afdc7 could not be found. Aug 01 16:45:51.784219 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:45:51.788873 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-6940c4e9-78d0-4f61-a607-b983c25bb77a tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Returning 404 to user: Instance 064171b4-a8a9-498c-bbd9-f51ff91afdc7 could not be found. {{(pid=118117) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:45:51.797143 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-6940c4e9-78d0-4f61-a607-b983c25bb77a tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "DELETE /compute/v2.1/servers/064171b4-a8a9-498c-bbd9-f51ff91afdc7" status: 404 len: 111 microversion: 2.1 time: 0.092399 Aug 01 16:45:51.797143 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 435/881] 10.222.0.45 () {58 vars in 1239 bytes} [Mon Aug 1 16:45:51 2022] DELETE /compute/v2.1/servers/064171b4-a8a9-498c-bbd9-f51ff91afdc7 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 16:45:51.808619 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-b353a494-c2c1-4930-9890-33e382e5f26a tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:51.810122 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-b353a494-c2c1-4930-9890-33e382e5f26a tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 064171b4-a8a9-498c-bbd9-f51ff91afdc7] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:51.832958 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-b353a494-c2c1-4930-9890-33e382e5f26a tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:51.834328 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-b353a494-c2c1-4930-9890-33e382e5f26a tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:51.836984 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-b353a494-c2c1-4930-9890-33e382e5f26a tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:51.838083 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-b353a494-c2c1-4930-9890-33e382e5f26a tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:51.882702 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.wsgi [None req-b353a494-c2c1-4930-9890-33e382e5f26a tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] HTTP exception thrown: Instance 064171b4-a8a9-498c-bbd9-f51ff91afdc7 could not be found. Aug 01 16:45:51.888062 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-b353a494-c2c1-4930-9890-33e382e5f26a tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Request method failure captured: Aug 01 16:45:51.888062 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: request: GET /compute/v2.1/servers/064171b4-a8a9-498c-bbd9-f51ff91afdc7 HTTP/1.1 Aug 01 16:45:51.888062 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Accept: application/json Aug 01 16:45:51.888062 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Accept-Encoding: identity Aug 01 16:45:51.888062 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Connection: close Aug 01 16:45:51.888062 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Content-Length: 0 Aug 01 16:45:51.888062 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Content-Type: application/json Aug 01 16:45:51.888062 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Host: 10.222.0.45 Aug 01 16:45:51.888062 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Openstack-System-Scope: None Aug 01 16:45:51.888062 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: User-Agent: python-urllib3/1.26.10 Aug 01 16:45:51.888062 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Auth-Token: gAAAAABi6AHCRDGoebg0LS7gmy1eTpjTuQd112Y1pcMjujKk6txGUWSA3OMMaHc1baNi_AdoDEvdhzRnASCOKOmNH90_reDUi0PqBGMG7mNlkYUDBNxMpR2mUAgvvel08FXbCsasfVUCgx1es__sgSc1ixE0JQKf1ZzhFBiBb0upY90FvmppuN0 Aug 01 16:45:51.888062 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Domain-Id: None Aug 01 16:45:51.888062 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Domain-Name: None Aug 01 16:45:51.888062 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Identity-Status: Confirmed Aug 01 16:45:51.888062 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Is-Admin-Project: True Aug 01 16:45:51.888062 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Domain-Id: default Aug 01 16:45:51.888062 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Domain-Name: Default Aug 01 16:45:51.888062 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Id: 2f46e472f8614c5e847ceb225cc9bff1 Aug 01 16:45:51.888062 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Name: tempest-AttachVolumeNegativeTest-597514302 Aug 01 16:45:51.888062 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Role: reader,member Aug 01 16:45:51.888062 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Roles: reader,member Aug 01 16:45:51.889698 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2f46e472f8614c5e847ceb225cc9bff1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2f46e472f8614c5e847ceb225cc9bff1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2f46e472f8614c5e847ceb225cc9bff1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2f46e472f8614c5e847ceb225cc9bff1"}]}] Aug 01 16:45:51.889698 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant: tempest-AttachVolumeNegativeTest-597514302 Aug 01 16:45:51.889698 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant-Id: 2f46e472f8614c5e847ceb225cc9bff1 Aug 01 16:45:51.889698 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-597514302 Aug 01 16:45:51.889698 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User: tempest-AttachVolumeNegativeTest-597514302-project Aug 01 16:45:51.889698 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Domain-Id: default Aug 01 16:45:51.889698 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Domain-Name: Default Aug 01 16:45:51.889698 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Id: 1ac7d3acf1204a9f98f9ee14c2b46a5e Aug 01 16:45:51.889698 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Name: tempest-AttachVolumeNegativeTest-597514302-project Aug 01 16:45:51.889698 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: method: > Aug 01 16:45:51.889698 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: exception: Instance 064171b4-a8a9-498c-bbd9-f51ff91afdc7 could not be found. Aug 01 16:45:51.889698 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: action_args: {'id': '064171b4-a8a9-498c-bbd9-f51ff91afdc7'} Aug 01 16:45:51.890633 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:45:51.890633 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:45:51.890633 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 16:45:51.890633 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 16:45:51.890633 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 16:45:51.890633 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 16:45:51.890633 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 16:45:51.890633 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 16:45:51.890633 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 16:45:51.890633 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 16:45:51.890633 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 064171b4-a8a9-498c-bbd9-f51ff91afdc7 could not be found. Aug 01 16:45:51.890633 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:45:51.890633 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:45:51.890633 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:45:51.890633 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:45:51.890633 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:45:51.890633 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:45:51.890633 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:45:51.890633 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:45:51.890633 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:45:51.891992 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:45:51.891992 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 16:45:51.891992 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 16:45:51.891992 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 16:45:51.891992 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 16:45:51.891992 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 16:45:51.891992 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:45:51.891992 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 064171b4-a8a9-498c-bbd9-f51ff91afdc7 could not be found. Aug 01 16:45:51.891992 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:45:51.891992 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:45:51.891992 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:45:51.891992 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:45:51.891992 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:45:51.891992 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:45:51.891992 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:45:51.891992 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:45:51.891992 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 064171b4-a8a9-498c-bbd9-f51ff91afdc7 could not be found. Aug 01 16:45:51.891992 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:45:51.893071 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-b353a494-c2c1-4930-9890-33e382e5f26a tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Returning 404 to user: Instance 064171b4-a8a9-498c-bbd9-f51ff91afdc7 could not be found. {{(pid=118118) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:45:51.893071 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-b353a494-c2c1-4930-9890-33e382e5f26a tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/064171b4-a8a9-498c-bbd9-f51ff91afdc7" status: 404 len: 111 microversion: 2.1 time: 0.089786 Aug 01 16:45:51.893071 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 447/882] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:45:51 2022] GET /compute/v2.1/servers/064171b4-a8a9-498c-bbd9-f51ff91afdc7 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 16:45:52.446333 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-0631e341-82e0-4c16-a73b-f9e1c2a6cb53 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:52.447665 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-0631e341-82e0-4c16-a73b-f9e1c2a6cb53 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:52.459934 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-0631e341-82e0-4c16-a73b-f9e1c2a6cb53 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:52.464466 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-0631e341-82e0-4c16-a73b-f9e1c2a6cb53 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:52.467220 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-0631e341-82e0-4c16-a73b-f9e1c2a6cb53 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:52.469288 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-0631e341-82e0-4c16-a73b-f9e1c2a6cb53 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:52.765956 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-0631e341-82e0-4c16-a73b-f9e1c2a6cb53 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:52.782965 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-0631e341-82e0-4c16-a73b-f9e1c2a6cb53 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:52.808022 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-0631e341-82e0-4c16-a73b-f9e1c2a6cb53 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:52.812805 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-0631e341-82e0-4c16-a73b-f9e1c2a6cb53 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926" status: 200 len: 1731 microversion: 2.20 time: 0.372807 Aug 01 16:45:52.825333 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 436/883] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:45:52 2022] GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926 => generated 1731 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:45:53.192600 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-4b9bd72a-9403-48b9-913c-22684d3fd78d tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:53.193838 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-4b9bd72a-9403-48b9-913c-22684d3fd78d tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 8ad215fb-dc14-4768-98d9-c57389e0d317] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:53.201329 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-4b9bd72a-9403-48b9-913c-22684d3fd78d tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:53.201760 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-4b9bd72a-9403-48b9-913c-22684d3fd78d tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:53.202527 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-4b9bd72a-9403-48b9-913c-22684d3fd78d tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:53.203137 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-4b9bd72a-9403-48b9-913c-22684d3fd78d tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:53.233903 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.wsgi [None req-4b9bd72a-9403-48b9-913c-22684d3fd78d tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] HTTP exception thrown: Instance 8ad215fb-dc14-4768-98d9-c57389e0d317 could not be found. Aug 01 16:45:53.235859 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-4b9bd72a-9403-48b9-913c-22684d3fd78d tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Request method failure captured: Aug 01 16:45:53.235859 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: request: DELETE /compute/v2.1/servers/8ad215fb-dc14-4768-98d9-c57389e0d317 HTTP/1.1 Aug 01 16:45:53.235859 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Accept: application/json Aug 01 16:45:53.235859 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Accept-Encoding: identity Aug 01 16:45:53.235859 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Connection: close Aug 01 16:45:53.235859 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Content-Length: 0 Aug 01 16:45:53.235859 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Content-Type: application/json Aug 01 16:45:53.235859 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Host: 10.222.0.45 Aug 01 16:45:53.235859 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Openstack-System-Scope: None Aug 01 16:45:53.235859 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: User-Agent: python-urllib3/1.26.10 Aug 01 16:45:53.235859 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Auth-Token: gAAAAABi6AHCRDGoebg0LS7gmy1eTpjTuQd112Y1pcMjujKk6txGUWSA3OMMaHc1baNi_AdoDEvdhzRnASCOKOmNH90_reDUi0PqBGMG7mNlkYUDBNxMpR2mUAgvvel08FXbCsasfVUCgx1es__sgSc1ixE0JQKf1ZzhFBiBb0upY90FvmppuN0 Aug 01 16:45:53.235859 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Domain-Id: None Aug 01 16:45:53.235859 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Domain-Name: None Aug 01 16:45:53.235859 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Identity-Status: Confirmed Aug 01 16:45:53.235859 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Is-Admin-Project: True Aug 01 16:45:53.235859 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Domain-Id: default Aug 01 16:45:53.235859 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Domain-Name: Default Aug 01 16:45:53.235859 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Id: 2f46e472f8614c5e847ceb225cc9bff1 Aug 01 16:45:53.235859 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Name: tempest-AttachVolumeNegativeTest-597514302 Aug 01 16:45:53.235859 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Role: reader,member Aug 01 16:45:53.235859 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Roles: reader,member Aug 01 16:45:53.237410 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2f46e472f8614c5e847ceb225cc9bff1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2f46e472f8614c5e847ceb225cc9bff1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2f46e472f8614c5e847ceb225cc9bff1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2f46e472f8614c5e847ceb225cc9bff1"}]}] Aug 01 16:45:53.237410 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant: tempest-AttachVolumeNegativeTest-597514302 Aug 01 16:45:53.237410 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant-Id: 2f46e472f8614c5e847ceb225cc9bff1 Aug 01 16:45:53.237410 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-597514302 Aug 01 16:45:53.237410 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User: tempest-AttachVolumeNegativeTest-597514302-project Aug 01 16:45:53.237410 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Domain-Id: default Aug 01 16:45:53.237410 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Domain-Name: Default Aug 01 16:45:53.237410 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Id: 1ac7d3acf1204a9f98f9ee14c2b46a5e Aug 01 16:45:53.237410 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Name: tempest-AttachVolumeNegativeTest-597514302-project Aug 01 16:45:53.237410 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: method: > Aug 01 16:45:53.237410 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: exception: Instance 8ad215fb-dc14-4768-98d9-c57389e0d317 could not be found. Aug 01 16:45:53.237410 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: action_args: {'id': '8ad215fb-dc14-4768-98d9-c57389e0d317'} Aug 01 16:45:53.238405 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:45:53.238405 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:45:53.238405 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 16:45:53.238405 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 16:45:53.238405 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 16:45:53.238405 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 16:45:53.238405 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 16:45:53.238405 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 16:45:53.238405 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 16:45:53.238405 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 16:45:53.238405 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ad215fb-dc14-4768-98d9-c57389e0d317 could not be found. Aug 01 16:45:53.238405 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:45:53.238405 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:45:53.238405 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:45:53.238405 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:45:53.238405 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:45:53.238405 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:45:53.238405 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:45:53.238405 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:45:53.238405 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:45:53.240202 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:45:53.240202 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 16:45:53.240202 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 16:45:53.240202 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 16:45:53.240202 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 16:45:53.240202 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 16:45:53.240202 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 16:45:53.240202 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 16:45:53.240202 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:45:53.240202 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ad215fb-dc14-4768-98d9-c57389e0d317 could not be found. Aug 01 16:45:53.240202 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:45:53.240202 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:45:53.240202 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:45:53.240202 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:45:53.240202 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:45:53.240202 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:45:53.240202 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:45:53.240202 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:45:53.240202 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ad215fb-dc14-4768-98d9-c57389e0d317 could not be found. Aug 01 16:45:53.240202 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:45:53.242809 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-4b9bd72a-9403-48b9-913c-22684d3fd78d tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Returning 404 to user: Instance 8ad215fb-dc14-4768-98d9-c57389e0d317 could not be found. {{(pid=118118) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:45:53.244129 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-4b9bd72a-9403-48b9-913c-22684d3fd78d tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "DELETE /compute/v2.1/servers/8ad215fb-dc14-4768-98d9-c57389e0d317" status: 404 len: 111 microversion: 2.1 time: 0.055215 Aug 01 16:45:53.245245 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 448/884] 10.222.0.45 () {58 vars in 1239 bytes} [Mon Aug 1 16:45:53 2022] DELETE /compute/v2.1/servers/8ad215fb-dc14-4768-98d9-c57389e0d317 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 16:45:53.254124 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-042db606-b172-46b8-8149-86675ee8a926 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:53.254756 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-042db606-b172-46b8-8149-86675ee8a926 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 8ad215fb-dc14-4768-98d9-c57389e0d317] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:53.262751 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-042db606-b172-46b8-8149-86675ee8a926 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:53.263214 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-042db606-b172-46b8-8149-86675ee8a926 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:53.264200 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-042db606-b172-46b8-8149-86675ee8a926 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:53.264682 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-042db606-b172-46b8-8149-86675ee8a926 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:53.286674 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.wsgi [None req-042db606-b172-46b8-8149-86675ee8a926 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] HTTP exception thrown: Instance 8ad215fb-dc14-4768-98d9-c57389e0d317 could not be found. Aug 01 16:45:53.289204 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-042db606-b172-46b8-8149-86675ee8a926 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Request method failure captured: Aug 01 16:45:53.289204 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: request: GET /compute/v2.1/servers/8ad215fb-dc14-4768-98d9-c57389e0d317 HTTP/1.1 Aug 01 16:45:53.289204 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Accept: application/json Aug 01 16:45:53.289204 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Accept-Encoding: identity Aug 01 16:45:53.289204 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Connection: close Aug 01 16:45:53.289204 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Content-Length: 0 Aug 01 16:45:53.289204 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Content-Type: application/json Aug 01 16:45:53.289204 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Host: 10.222.0.45 Aug 01 16:45:53.289204 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Openstack-System-Scope: None Aug 01 16:45:53.289204 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: User-Agent: python-urllib3/1.26.10 Aug 01 16:45:53.289204 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Auth-Token: gAAAAABi6AHCRDGoebg0LS7gmy1eTpjTuQd112Y1pcMjujKk6txGUWSA3OMMaHc1baNi_AdoDEvdhzRnASCOKOmNH90_reDUi0PqBGMG7mNlkYUDBNxMpR2mUAgvvel08FXbCsasfVUCgx1es__sgSc1ixE0JQKf1ZzhFBiBb0upY90FvmppuN0 Aug 01 16:45:53.289204 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Domain-Id: None Aug 01 16:45:53.289204 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Domain-Name: None Aug 01 16:45:53.289204 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Identity-Status: Confirmed Aug 01 16:45:53.289204 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Is-Admin-Project: True Aug 01 16:45:53.289204 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Domain-Id: default Aug 01 16:45:53.289204 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Domain-Name: Default Aug 01 16:45:53.289204 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Id: 2f46e472f8614c5e847ceb225cc9bff1 Aug 01 16:45:53.289204 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Name: tempest-AttachVolumeNegativeTest-597514302 Aug 01 16:45:53.289204 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Role: reader,member Aug 01 16:45:53.289204 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Roles: reader,member Aug 01 16:45:53.291482 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2f46e472f8614c5e847ceb225cc9bff1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2f46e472f8614c5e847ceb225cc9bff1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2f46e472f8614c5e847ceb225cc9bff1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2f46e472f8614c5e847ceb225cc9bff1"}]}] Aug 01 16:45:53.291482 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Tenant: tempest-AttachVolumeNegativeTest-597514302 Aug 01 16:45:53.291482 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Tenant-Id: 2f46e472f8614c5e847ceb225cc9bff1 Aug 01 16:45:53.291482 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-597514302 Aug 01 16:45:53.291482 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User: tempest-AttachVolumeNegativeTest-597514302-project Aug 01 16:45:53.291482 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Domain-Id: default Aug 01 16:45:53.291482 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Domain-Name: Default Aug 01 16:45:53.291482 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Id: 1ac7d3acf1204a9f98f9ee14c2b46a5e Aug 01 16:45:53.291482 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Name: tempest-AttachVolumeNegativeTest-597514302-project Aug 01 16:45:53.291482 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: method: > Aug 01 16:45:53.291482 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: exception: Instance 8ad215fb-dc14-4768-98d9-c57389e0d317 could not be found. Aug 01 16:45:53.291482 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: action_args: {'id': '8ad215fb-dc14-4768-98d9-c57389e0d317'} Aug 01 16:45:53.292440 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:45:53.292440 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:45:53.292440 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 16:45:53.292440 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 16:45:53.292440 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 16:45:53.292440 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 16:45:53.292440 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 16:45:53.292440 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 16:45:53.292440 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 16:45:53.292440 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 16:45:53.292440 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ad215fb-dc14-4768-98d9-c57389e0d317 could not be found. Aug 01 16:45:53.292440 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:45:53.292440 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:45:53.292440 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:45:53.292440 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:45:53.292440 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:45:53.292440 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:45:53.292440 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:45:53.292440 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:45:53.292440 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:45:53.293787 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:45:53.293787 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 16:45:53.293787 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 16:45:53.293787 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 16:45:53.293787 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 16:45:53.293787 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 16:45:53.293787 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:45:53.293787 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ad215fb-dc14-4768-98d9-c57389e0d317 could not be found. Aug 01 16:45:53.293787 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:45:53.293787 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:45:53.293787 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:45:53.293787 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:45:53.293787 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:45:53.293787 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:45:53.293787 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:45:53.293787 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:45:53.293787 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ad215fb-dc14-4768-98d9-c57389e0d317 could not be found. Aug 01 16:45:53.293787 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:45:53.296446 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-042db606-b172-46b8-8149-86675ee8a926 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Returning 404 to user: Instance 8ad215fb-dc14-4768-98d9-c57389e0d317 could not be found. {{(pid=118117) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:45:53.297532 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-042db606-b172-46b8-8149-86675ee8a926 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/8ad215fb-dc14-4768-98d9-c57389e0d317" status: 404 len: 111 microversion: 2.1 time: 0.048141 Aug 01 16:45:53.304267 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 437/885] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:45:53 2022] GET /compute/v2.1/servers/8ad215fb-dc14-4768-98d9-c57389e0d317 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 16:45:53.310234 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-8e881f56-71d5-4fe2-9951-5c7ec10722a9 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:53.311082 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-8e881f56-71d5-4fe2-9951-5c7ec10722a9 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 53e1f340-623b-4453-8735-db4701fef4ad] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:53.335926 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-8e881f56-71d5-4fe2-9951-5c7ec10722a9 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:53.336955 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-8e881f56-71d5-4fe2-9951-5c7ec10722a9 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:53.338546 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-8e881f56-71d5-4fe2-9951-5c7ec10722a9 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:53.339737 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-8e881f56-71d5-4fe2-9951-5c7ec10722a9 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:53.383612 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.wsgi [None req-8e881f56-71d5-4fe2-9951-5c7ec10722a9 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] HTTP exception thrown: Instance 53e1f340-623b-4453-8735-db4701fef4ad could not be found. Aug 01 16:45:53.389624 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-8e881f56-71d5-4fe2-9951-5c7ec10722a9 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Request method failure captured: Aug 01 16:45:53.389624 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: request: DELETE /compute/v2.1/servers/53e1f340-623b-4453-8735-db4701fef4ad HTTP/1.1 Aug 01 16:45:53.389624 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Accept: application/json Aug 01 16:45:53.389624 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Accept-Encoding: identity Aug 01 16:45:53.389624 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Connection: close Aug 01 16:45:53.389624 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Content-Length: 0 Aug 01 16:45:53.389624 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Content-Type: application/json Aug 01 16:45:53.389624 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Host: 10.222.0.45 Aug 01 16:45:53.389624 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Openstack-System-Scope: None Aug 01 16:45:53.389624 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: User-Agent: python-urllib3/1.26.10 Aug 01 16:45:53.389624 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Auth-Token: gAAAAABi6AHCRDGoebg0LS7gmy1eTpjTuQd112Y1pcMjujKk6txGUWSA3OMMaHc1baNi_AdoDEvdhzRnASCOKOmNH90_reDUi0PqBGMG7mNlkYUDBNxMpR2mUAgvvel08FXbCsasfVUCgx1es__sgSc1ixE0JQKf1ZzhFBiBb0upY90FvmppuN0 Aug 01 16:45:53.389624 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Domain-Id: None Aug 01 16:45:53.389624 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Domain-Name: None Aug 01 16:45:53.389624 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Identity-Status: Confirmed Aug 01 16:45:53.389624 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Is-Admin-Project: True Aug 01 16:45:53.389624 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Domain-Id: default Aug 01 16:45:53.389624 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Domain-Name: Default Aug 01 16:45:53.389624 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Id: 2f46e472f8614c5e847ceb225cc9bff1 Aug 01 16:45:53.389624 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Name: tempest-AttachVolumeNegativeTest-597514302 Aug 01 16:45:53.389624 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Role: reader,member Aug 01 16:45:53.389624 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Roles: reader,member Aug 01 16:45:53.391319 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2f46e472f8614c5e847ceb225cc9bff1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2f46e472f8614c5e847ceb225cc9bff1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2f46e472f8614c5e847ceb225cc9bff1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2f46e472f8614c5e847ceb225cc9bff1"}]}] Aug 01 16:45:53.391319 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant: tempest-AttachVolumeNegativeTest-597514302 Aug 01 16:45:53.391319 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant-Id: 2f46e472f8614c5e847ceb225cc9bff1 Aug 01 16:45:53.391319 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-597514302 Aug 01 16:45:53.391319 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User: tempest-AttachVolumeNegativeTest-597514302-project Aug 01 16:45:53.391319 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Domain-Id: default Aug 01 16:45:53.391319 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Domain-Name: Default Aug 01 16:45:53.391319 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Id: 1ac7d3acf1204a9f98f9ee14c2b46a5e Aug 01 16:45:53.391319 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Name: tempest-AttachVolumeNegativeTest-597514302-project Aug 01 16:45:53.391319 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: method: > Aug 01 16:45:53.391319 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: exception: Instance 53e1f340-623b-4453-8735-db4701fef4ad could not be found. Aug 01 16:45:53.391319 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: action_args: {'id': '53e1f340-623b-4453-8735-db4701fef4ad'} Aug 01 16:45:53.392277 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:45:53.392277 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:45:53.392277 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 16:45:53.392277 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 16:45:53.392277 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 16:45:53.392277 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 16:45:53.392277 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 16:45:53.392277 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 16:45:53.392277 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 16:45:53.392277 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 16:45:53.392277 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53e1f340-623b-4453-8735-db4701fef4ad could not be found. Aug 01 16:45:53.392277 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:45:53.392277 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:45:53.392277 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:45:53.392277 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:45:53.392277 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:45:53.392277 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:45:53.392277 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:45:53.392277 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:45:53.392277 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:45:53.393768 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:45:53.393768 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 16:45:53.393768 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 16:45:53.393768 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 16:45:53.393768 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 16:45:53.393768 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 16:45:53.393768 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 16:45:53.393768 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 16:45:53.393768 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:45:53.393768 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53e1f340-623b-4453-8735-db4701fef4ad could not be found. Aug 01 16:45:53.393768 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:45:53.393768 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:45:53.393768 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:45:53.393768 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:45:53.393768 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:45:53.393768 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:45:53.393768 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:45:53.393768 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:45:53.393768 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53e1f340-623b-4453-8735-db4701fef4ad could not be found. Aug 01 16:45:53.393768 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:45:53.395287 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-8e881f56-71d5-4fe2-9951-5c7ec10722a9 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Returning 404 to user: Instance 53e1f340-623b-4453-8735-db4701fef4ad could not be found. {{(pid=118118) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:45:53.397802 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-8e881f56-71d5-4fe2-9951-5c7ec10722a9 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "DELETE /compute/v2.1/servers/53e1f340-623b-4453-8735-db4701fef4ad" status: 404 len: 111 microversion: 2.1 time: 0.094321 Aug 01 16:45:53.399692 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 449/886] 10.222.0.45 () {58 vars in 1239 bytes} [Mon Aug 1 16:45:53 2022] DELETE /compute/v2.1/servers/53e1f340-623b-4453-8735-db4701fef4ad => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 01 16:45:53.411634 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-66ea2c0c-2a7a-4779-9c78-233cd68b0def tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:53.412587 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-66ea2c0c-2a7a-4779-9c78-233cd68b0def tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 53e1f340-623b-4453-8735-db4701fef4ad] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:53.440313 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-66ea2c0c-2a7a-4779-9c78-233cd68b0def tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:53.440953 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-66ea2c0c-2a7a-4779-9c78-233cd68b0def tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:53.441548 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-66ea2c0c-2a7a-4779-9c78-233cd68b0def tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:53.441979 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-66ea2c0c-2a7a-4779-9c78-233cd68b0def tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:53.476137 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.wsgi [None req-66ea2c0c-2a7a-4779-9c78-233cd68b0def tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] HTTP exception thrown: Instance 53e1f340-623b-4453-8735-db4701fef4ad could not be found. Aug 01 16:45:53.479657 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-66ea2c0c-2a7a-4779-9c78-233cd68b0def tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Request method failure captured: Aug 01 16:45:53.479657 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: request: GET /compute/v2.1/servers/53e1f340-623b-4453-8735-db4701fef4ad HTTP/1.1 Aug 01 16:45:53.479657 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Accept: application/json Aug 01 16:45:53.479657 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Accept-Encoding: identity Aug 01 16:45:53.479657 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Connection: close Aug 01 16:45:53.479657 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Content-Length: 0 Aug 01 16:45:53.479657 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Content-Type: application/json Aug 01 16:45:53.479657 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Host: 10.222.0.45 Aug 01 16:45:53.479657 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Openstack-System-Scope: None Aug 01 16:45:53.479657 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: User-Agent: python-urllib3/1.26.10 Aug 01 16:45:53.479657 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Auth-Token: gAAAAABi6AHCRDGoebg0LS7gmy1eTpjTuQd112Y1pcMjujKk6txGUWSA3OMMaHc1baNi_AdoDEvdhzRnASCOKOmNH90_reDUi0PqBGMG7mNlkYUDBNxMpR2mUAgvvel08FXbCsasfVUCgx1es__sgSc1ixE0JQKf1ZzhFBiBb0upY90FvmppuN0 Aug 01 16:45:53.479657 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Domain-Id: None Aug 01 16:45:53.479657 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Domain-Name: None Aug 01 16:45:53.479657 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Identity-Status: Confirmed Aug 01 16:45:53.479657 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Is-Admin-Project: True Aug 01 16:45:53.479657 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Domain-Id: default Aug 01 16:45:53.479657 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Domain-Name: Default Aug 01 16:45:53.479657 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Id: 2f46e472f8614c5e847ceb225cc9bff1 Aug 01 16:45:53.479657 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Name: tempest-AttachVolumeNegativeTest-597514302 Aug 01 16:45:53.479657 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Role: reader,member Aug 01 16:45:53.479657 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Roles: reader,member Aug 01 16:45:53.485029 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2f46e472f8614c5e847ceb225cc9bff1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2f46e472f8614c5e847ceb225cc9bff1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2f46e472f8614c5e847ceb225cc9bff1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2f46e472f8614c5e847ceb225cc9bff1"}]}] Aug 01 16:45:53.485029 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Tenant: tempest-AttachVolumeNegativeTest-597514302 Aug 01 16:45:53.485029 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Tenant-Id: 2f46e472f8614c5e847ceb225cc9bff1 Aug 01 16:45:53.485029 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-597514302 Aug 01 16:45:53.485029 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User: tempest-AttachVolumeNegativeTest-597514302-project Aug 01 16:45:53.485029 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Domain-Id: default Aug 01 16:45:53.485029 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Domain-Name: Default Aug 01 16:45:53.485029 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Id: 1ac7d3acf1204a9f98f9ee14c2b46a5e Aug 01 16:45:53.485029 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Name: tempest-AttachVolumeNegativeTest-597514302-project Aug 01 16:45:53.485029 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: method: > Aug 01 16:45:53.485029 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: exception: Instance 53e1f340-623b-4453-8735-db4701fef4ad could not be found. Aug 01 16:45:53.485029 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: action_args: {'id': '53e1f340-623b-4453-8735-db4701fef4ad'} Aug 01 16:45:53.486077 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:45:53.486077 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:45:53.486077 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 16:45:53.486077 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 16:45:53.486077 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 16:45:53.486077 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 16:45:53.486077 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 16:45:53.486077 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 16:45:53.486077 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 16:45:53.486077 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 16:45:53.486077 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53e1f340-623b-4453-8735-db4701fef4ad could not be found. Aug 01 16:45:53.486077 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:45:53.486077 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:45:53.486077 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:45:53.486077 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:45:53.486077 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:45:53.486077 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:45:53.486077 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:45:53.486077 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:45:53.486077 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:45:53.488102 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:45:53.488102 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 16:45:53.488102 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 16:45:53.488102 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 16:45:53.488102 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 16:45:53.488102 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 16:45:53.488102 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:45:53.488102 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53e1f340-623b-4453-8735-db4701fef4ad could not be found. Aug 01 16:45:53.488102 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:45:53.488102 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:45:53.488102 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:45:53.488102 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:45:53.488102 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:45:53.488102 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:45:53.488102 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:45:53.488102 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:45:53.488102 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53e1f340-623b-4453-8735-db4701fef4ad could not be found. Aug 01 16:45:53.488102 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:45:53.490439 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-66ea2c0c-2a7a-4779-9c78-233cd68b0def tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Returning 404 to user: Instance 53e1f340-623b-4453-8735-db4701fef4ad could not be found. {{(pid=118117) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:45:53.490439 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-66ea2c0c-2a7a-4779-9c78-233cd68b0def tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/53e1f340-623b-4453-8735-db4701fef4ad" status: 404 len: 111 microversion: 2.1 time: 0.075995 Aug 01 16:45:53.490439 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 438/887] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:45:53 2022] GET /compute/v2.1/servers/53e1f340-623b-4453-8735-db4701fef4ad => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 16:45:53.856309 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-b355080b-aa95-428e-9d75-7b5d87af9c5c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:53.857003 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-b355080b-aa95-428e-9d75-7b5d87af9c5c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:53.865214 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-b355080b-aa95-428e-9d75-7b5d87af9c5c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:53.866051 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-b355080b-aa95-428e-9d75-7b5d87af9c5c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:53.867051 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-b355080b-aa95-428e-9d75-7b5d87af9c5c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:53.867654 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-b355080b-aa95-428e-9d75-7b5d87af9c5c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:54.133976 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-b355080b-aa95-428e-9d75-7b5d87af9c5c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:54.152530 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-b355080b-aa95-428e-9d75-7b5d87af9c5c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:54.154169 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-b355080b-aa95-428e-9d75-7b5d87af9c5c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:54.155359 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-b355080b-aa95-428e-9d75-7b5d87af9c5c tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926" status: 200 len: 1731 microversion: 2.20 time: 0.303999 Aug 01 16:45:54.157408 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 450/888] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:45:53 2022] GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926 => generated 1731 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 16:45:54.780495 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-62dc5c66-4aa5-43e8-b993-113a020d66ab tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:54.781392 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-62dc5c66-4aa5-43e8-b993-113a020d66ab tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 430702ec-add7-4d23-a875-36d09e281f0a] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:54.803033 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-62dc5c66-4aa5-43e8-b993-113a020d66ab tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:54.804782 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-62dc5c66-4aa5-43e8-b993-113a020d66ab tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:54.806487 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-62dc5c66-4aa5-43e8-b993-113a020d66ab tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:54.807696 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-62dc5c66-4aa5-43e8-b993-113a020d66ab tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:54.840580 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.wsgi [None req-62dc5c66-4aa5-43e8-b993-113a020d66ab tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] HTTP exception thrown: Instance 430702ec-add7-4d23-a875-36d09e281f0a could not be found. Aug 01 16:45:54.843736 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-62dc5c66-4aa5-43e8-b993-113a020d66ab tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Request method failure captured: Aug 01 16:45:54.843736 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: request: DELETE /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a HTTP/1.1 Aug 01 16:45:54.843736 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Accept: application/json Aug 01 16:45:54.843736 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Accept-Encoding: identity Aug 01 16:45:54.843736 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Connection: close Aug 01 16:45:54.843736 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Content-Length: 0 Aug 01 16:45:54.843736 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Content-Type: application/json Aug 01 16:45:54.843736 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Host: 10.222.0.45 Aug 01 16:45:54.843736 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Openstack-System-Scope: None Aug 01 16:45:54.843736 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: User-Agent: python-urllib3/1.26.10 Aug 01 16:45:54.843736 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Auth-Token: gAAAAABi6AHCRDGoebg0LS7gmy1eTpjTuQd112Y1pcMjujKk6txGUWSA3OMMaHc1baNi_AdoDEvdhzRnASCOKOmNH90_reDUi0PqBGMG7mNlkYUDBNxMpR2mUAgvvel08FXbCsasfVUCgx1es__sgSc1ixE0JQKf1ZzhFBiBb0upY90FvmppuN0 Aug 01 16:45:54.843736 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Domain-Id: None Aug 01 16:45:54.843736 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Domain-Name: None Aug 01 16:45:54.843736 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Identity-Status: Confirmed Aug 01 16:45:54.843736 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Is-Admin-Project: True Aug 01 16:45:54.843736 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Domain-Id: default Aug 01 16:45:54.843736 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Domain-Name: Default Aug 01 16:45:54.843736 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Id: 2f46e472f8614c5e847ceb225cc9bff1 Aug 01 16:45:54.843736 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Name: tempest-AttachVolumeNegativeTest-597514302 Aug 01 16:45:54.843736 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Role: reader,member Aug 01 16:45:54.843736 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Roles: reader,member Aug 01 16:45:54.846557 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2f46e472f8614c5e847ceb225cc9bff1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2f46e472f8614c5e847ceb225cc9bff1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2f46e472f8614c5e847ceb225cc9bff1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2f46e472f8614c5e847ceb225cc9bff1"}]}] Aug 01 16:45:54.846557 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Tenant: tempest-AttachVolumeNegativeTest-597514302 Aug 01 16:45:54.846557 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Tenant-Id: 2f46e472f8614c5e847ceb225cc9bff1 Aug 01 16:45:54.846557 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-597514302 Aug 01 16:45:54.846557 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User: tempest-AttachVolumeNegativeTest-597514302-project Aug 01 16:45:54.846557 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Domain-Id: default Aug 01 16:45:54.846557 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Domain-Name: Default Aug 01 16:45:54.846557 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Id: 1ac7d3acf1204a9f98f9ee14c2b46a5e Aug 01 16:45:54.846557 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Name: tempest-AttachVolumeNegativeTest-597514302-project Aug 01 16:45:54.846557 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: method: > Aug 01 16:45:54.846557 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: exception: Instance 430702ec-add7-4d23-a875-36d09e281f0a could not be found. Aug 01 16:45:54.846557 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: action_args: {'id': '430702ec-add7-4d23-a875-36d09e281f0a'} Aug 01 16:45:54.847838 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:45:54.847838 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:45:54.847838 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 16:45:54.847838 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 16:45:54.847838 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 16:45:54.847838 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 16:45:54.847838 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 16:45:54.847838 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 16:45:54.847838 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 16:45:54.847838 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 16:45:54.847838 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 430702ec-add7-4d23-a875-36d09e281f0a could not be found. Aug 01 16:45:54.847838 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:45:54.847838 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:45:54.847838 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:45:54.847838 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:45:54.847838 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:45:54.847838 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:45:54.847838 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:45:54.847838 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:45:54.847838 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:45:54.850942 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:45:54.850942 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 16:45:54.850942 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 16:45:54.850942 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 16:45:54.850942 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 16:45:54.850942 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 16:45:54.850942 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 16:45:54.850942 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 16:45:54.850942 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:45:54.850942 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 430702ec-add7-4d23-a875-36d09e281f0a could not be found. Aug 01 16:45:54.850942 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:45:54.850942 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:45:54.850942 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:45:54.850942 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:45:54.850942 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:45:54.850942 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:45:54.850942 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:45:54.850942 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:45:54.850942 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 430702ec-add7-4d23-a875-36d09e281f0a could not be found. Aug 01 16:45:54.850942 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:45:54.857679 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-62dc5c66-4aa5-43e8-b993-113a020d66ab tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Returning 404 to user: Instance 430702ec-add7-4d23-a875-36d09e281f0a could not be found. {{(pid=118117) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:45:54.857679 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-62dc5c66-4aa5-43e8-b993-113a020d66ab tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "DELETE /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a" status: 404 len: 111 microversion: 2.1 time: 0.081642 Aug 01 16:45:54.858254 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 439/889] 10.222.0.45 () {58 vars in 1239 bytes} [Mon Aug 1 16:45:54 2022] DELETE /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 16:45:54.865802 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-09a8e21c-601a-45d2-a58d-6eb9666fa2b1 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:54.865802 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-09a8e21c-601a-45d2-a58d-6eb9666fa2b1 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] [instance: 430702ec-add7-4d23-a875-36d09e281f0a] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:54.876198 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-09a8e21c-601a-45d2-a58d-6eb9666fa2b1 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:54.877834 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-09a8e21c-601a-45d2-a58d-6eb9666fa2b1 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:54.878867 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-09a8e21c-601a-45d2-a58d-6eb9666fa2b1 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:54.879406 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-09a8e21c-601a-45d2-a58d-6eb9666fa2b1 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:54.887017 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:45:54.906685 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.wsgi [None req-09a8e21c-601a-45d2-a58d-6eb9666fa2b1 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] HTTP exception thrown: Instance 430702ec-add7-4d23-a875-36d09e281f0a could not be found. Aug 01 16:45:54.909116 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-09a8e21c-601a-45d2-a58d-6eb9666fa2b1 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Request method failure captured: Aug 01 16:45:54.909116 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: request: GET /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a HTTP/1.1 Aug 01 16:45:54.909116 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Accept: application/json Aug 01 16:45:54.909116 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Accept-Encoding: identity Aug 01 16:45:54.909116 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Connection: close Aug 01 16:45:54.909116 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Content-Length: 0 Aug 01 16:45:54.909116 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Content-Type: application/json Aug 01 16:45:54.909116 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Host: 10.222.0.45 Aug 01 16:45:54.909116 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Openstack-System-Scope: None Aug 01 16:45:54.909116 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: User-Agent: python-urllib3/1.26.10 Aug 01 16:45:54.909116 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Auth-Token: gAAAAABi6AHCRDGoebg0LS7gmy1eTpjTuQd112Y1pcMjujKk6txGUWSA3OMMaHc1baNi_AdoDEvdhzRnASCOKOmNH90_reDUi0PqBGMG7mNlkYUDBNxMpR2mUAgvvel08FXbCsasfVUCgx1es__sgSc1ixE0JQKf1ZzhFBiBb0upY90FvmppuN0 Aug 01 16:45:54.909116 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Domain-Id: None Aug 01 16:45:54.909116 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Domain-Name: None Aug 01 16:45:54.909116 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Identity-Status: Confirmed Aug 01 16:45:54.909116 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Is-Admin-Project: True Aug 01 16:45:54.909116 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Domain-Id: default Aug 01 16:45:54.909116 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Domain-Name: Default Aug 01 16:45:54.909116 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Id: 2f46e472f8614c5e847ceb225cc9bff1 Aug 01 16:45:54.909116 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Name: tempest-AttachVolumeNegativeTest-597514302 Aug 01 16:45:54.909116 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Role: reader,member Aug 01 16:45:54.909116 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Roles: reader,member Aug 01 16:45:54.911051 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2f46e472f8614c5e847ceb225cc9bff1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2f46e472f8614c5e847ceb225cc9bff1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2f46e472f8614c5e847ceb225cc9bff1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2f46e472f8614c5e847ceb225cc9bff1"}]}] Aug 01 16:45:54.911051 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant: tempest-AttachVolumeNegativeTest-597514302 Aug 01 16:45:54.911051 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant-Id: 2f46e472f8614c5e847ceb225cc9bff1 Aug 01 16:45:54.911051 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-597514302 Aug 01 16:45:54.911051 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User: tempest-AttachVolumeNegativeTest-597514302-project Aug 01 16:45:54.911051 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Domain-Id: default Aug 01 16:45:54.911051 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Domain-Name: Default Aug 01 16:45:54.911051 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Id: 1ac7d3acf1204a9f98f9ee14c2b46a5e Aug 01 16:45:54.911051 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Name: tempest-AttachVolumeNegativeTest-597514302-project Aug 01 16:45:54.911051 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: method: > Aug 01 16:45:54.911051 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: exception: Instance 430702ec-add7-4d23-a875-36d09e281f0a could not be found. Aug 01 16:45:54.911051 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: action_args: {'id': '430702ec-add7-4d23-a875-36d09e281f0a'} Aug 01 16:45:54.912345 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:45:54.912345 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:45:54.912345 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 16:45:54.912345 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 16:45:54.912345 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 16:45:54.912345 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 16:45:54.912345 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 16:45:54.912345 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 16:45:54.912345 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 16:45:54.912345 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 16:45:54.912345 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 430702ec-add7-4d23-a875-36d09e281f0a could not be found. Aug 01 16:45:54.912345 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:45:54.912345 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:45:54.912345 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:45:54.912345 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:45:54.912345 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:45:54.912345 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:45:54.912345 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:45:54.912345 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:45:54.912345 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:45:54.914835 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:45:54.914835 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 16:45:54.914835 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 16:45:54.914835 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 16:45:54.914835 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 16:45:54.914835 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 16:45:54.914835 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:45:54.914835 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 430702ec-add7-4d23-a875-36d09e281f0a could not be found. Aug 01 16:45:54.914835 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:45:54.914835 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:45:54.914835 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:45:54.914835 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:45:54.914835 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:45:54.914835 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:45:54.914835 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:45:54.914835 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:45:54.914835 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 430702ec-add7-4d23-a875-36d09e281f0a could not be found. Aug 01 16:45:54.914835 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:45:54.916896 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-09a8e21c-601a-45d2-a58d-6eb9666fa2b1 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] Returning 404 to user: Instance 430702ec-add7-4d23-a875-36d09e281f0a could not be found. {{(pid=118118) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:45:54.916896 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-09a8e21c-601a-45d2-a58d-6eb9666fa2b1 tempest-AttachVolumeNegativeTest-597514302 tempest-AttachVolumeNegativeTest-597514302-project] 10.222.0.45 "GET /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a" status: 404 len: 111 microversion: 2.1 time: 0.052601 Aug 01 16:45:54.916896 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 451/890] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:45:54 2022] GET /compute/v2.1/servers/430702ec-add7-4d23-a875-36d09e281f0a => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 16:45:55.200951 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-d638df97-0a24-48c1-a3f0-dd0fbd71d393 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:55.203058 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-d638df97-0a24-48c1-a3f0-dd0fbd71d393 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:55.222327 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-d638df97-0a24-48c1-a3f0-dd0fbd71d393 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:55.228040 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-d638df97-0a24-48c1-a3f0-dd0fbd71d393 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:55.232362 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-d638df97-0a24-48c1-a3f0-dd0fbd71d393 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:55.233493 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-d638df97-0a24-48c1-a3f0-dd0fbd71d393 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:55.622906 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-d638df97-0a24-48c1-a3f0-dd0fbd71d393 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:55.638011 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-d638df97-0a24-48c1-a3f0-dd0fbd71d393 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:55.641094 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-d638df97-0a24-48c1-a3f0-dd0fbd71d393 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:55.643235 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-d638df97-0a24-48c1-a3f0-dd0fbd71d393 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926" status: 200 len: 1731 microversion: 2.20 time: 0.451920 Aug 01 16:45:55.644259 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 440/891] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:45:55 2022] GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926 => generated 1731 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:45:56.673428 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-30cda546-41b8-4a41-9eb3-a69b7a908459 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:56.673428 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-30cda546-41b8-4a41-9eb3-a69b7a908459 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:56.674836 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_api:SELECT=57,nova_api:DELETE=1 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:45:56.686819 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-30cda546-41b8-4a41-9eb3-a69b7a908459 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:56.687631 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-30cda546-41b8-4a41-9eb3-a69b7a908459 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:56.688736 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-30cda546-41b8-4a41-9eb3-a69b7a908459 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:56.689309 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-30cda546-41b8-4a41-9eb3-a69b7a908459 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:56.902562 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-30cda546-41b8-4a41-9eb3-a69b7a908459 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:56.914011 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-30cda546-41b8-4a41-9eb3-a69b7a908459 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:56.916321 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-30cda546-41b8-4a41-9eb3-a69b7a908459 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:56.918293 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-30cda546-41b8-4a41-9eb3-a69b7a908459 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926" status: 200 len: 1731 microversion: 2.20 time: 0.255059 Aug 01 16:45:56.918952 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 452/892] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:45:56 2022] GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926 => generated 1731 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:45:57.943577 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-9a2ad1cb-5ae5-45ed-a997-6886af319fe6 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:57.944442 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-9a2ad1cb-5ae5-45ed-a997-6886af319fe6 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:57.952164 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-9a2ad1cb-5ae5-45ed-a997-6886af319fe6 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:57.952703 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-9a2ad1cb-5ae5-45ed-a997-6886af319fe6 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:57.953577 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-9a2ad1cb-5ae5-45ed-a997-6886af319fe6 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:57.954152 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-9a2ad1cb-5ae5-45ed-a997-6886af319fe6 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:58.175296 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-9a2ad1cb-5ae5-45ed-a997-6886af319fe6 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:58.185738 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-9a2ad1cb-5ae5-45ed-a997-6886af319fe6 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:58.186774 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-9a2ad1cb-5ae5-45ed-a997-6886af319fe6 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:58.188029 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-9a2ad1cb-5ae5-45ed-a997-6886af319fe6 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926" status: 200 len: 1731 microversion: 2.20 time: 0.249337 Aug 01 16:45:58.188589 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 441/893] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:45:57 2022] GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926 => generated 1731 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:45:59.215261 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-a9064385-5997-4945-8bc2-14c146fb3f27 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:45:59.216622 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-a9064385-5997-4945-8bc2-14c146fb3f27 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:45:59.225230 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a9064385-5997-4945-8bc2-14c146fb3f27 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:59.225917 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a9064385-5997-4945-8bc2-14c146fb3f27 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:59.226911 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a9064385-5997-4945-8bc2-14c146fb3f27 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:45:59.227519 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a9064385-5997-4945-8bc2-14c146fb3f27 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:45:59.487918 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-a9064385-5997-4945-8bc2-14c146fb3f27 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:59.497610 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-a9064385-5997-4945-8bc2-14c146fb3f27 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:59.499293 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-a9064385-5997-4945-8bc2-14c146fb3f27 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:45:59.500764 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-a9064385-5997-4945-8bc2-14c146fb3f27 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926" status: 200 len: 1731 microversion: 2.20 time: 0.291842 Aug 01 16:45:59.501546 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 453/894] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:45:59 2022] GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926 => generated 1731 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:46:00.524541 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-c8ca13ff-43d1-42c3-90fd-47f31bff73c8 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:46:00.525358 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-c8ca13ff-43d1-42c3-90fd-47f31bff73c8 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:46:00.532937 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-c8ca13ff-43d1-42c3-90fd-47f31bff73c8 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:00.533384 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-c8ca13ff-43d1-42c3-90fd-47f31bff73c8 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:00.534173 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-c8ca13ff-43d1-42c3-90fd-47f31bff73c8 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:00.534586 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-c8ca13ff-43d1-42c3-90fd-47f31bff73c8 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:00.710642 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-c8ca13ff-43d1-42c3-90fd-47f31bff73c8 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:46:00.721775 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-c8ca13ff-43d1-42c3-90fd-47f31bff73c8 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:46:00.723196 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-c8ca13ff-43d1-42c3-90fd-47f31bff73c8 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:46:00.725480 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-c8ca13ff-43d1-42c3-90fd-47f31bff73c8 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926" status: 200 len: 1731 microversion: 2.20 time: 0.204771 Aug 01 16:46:00.726372 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 442/895] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:46:00 2022] GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926 => generated 1731 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:46:00.930703 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-b70eb85b-33ee-4b66-ba42-f850ceeb4f6d tempest-VolumesGetTestJSON-840255829 tempest-VolumesGetTestJSON-840255829-project] Action: 'create', calling method: .version_select at 0x7efd6749fca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1864234569", "metadata": {"Type": "work"}}} {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:46:01.341804 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-b70eb85b-33ee-4b66-ba42-f850ceeb4f6d tempest-VolumesGetTestJSON-840255829 tempest-VolumesGetTestJSON-840255829-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.543510 Aug 01 16:46:01.342541 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 454/896] 10.222.0.45 () {60 vars in 1156 bytes} [Mon Aug 1 16:46:00 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 545 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 01 16:46:01.366748 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-6dbb3e8c-7185-4f2d-a16a-1f28feea187c tempest-VolumesGetTestJSON-840255829 tempest-VolumesGetTestJSON-840255829-project] Calling method '.version_select at 0x7efd5eb8f310>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:46:01.439321 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-6dbb3e8c-7185-4f2d-a16a-1f28feea187c tempest-VolumesGetTestJSON-840255829 tempest-VolumesGetTestJSON-840255829-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/fa43d89b-1ce4-42dc-b356-af91a0836fff" status: 200 len: 353 microversion: 2.1 time: 0.079250 Aug 01 16:46:01.439965 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 443/897] 10.222.0.45 () {58 vars in 1245 bytes} [Mon Aug 1 16:46:01 2022] GET /compute/v2.1/os-volumes/fa43d89b-1ce4-42dc-b356-af91a0836fff => generated 353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:46:01.750210 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-c5307d67-bb0c-4822-8931-591f5e73d1a1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:46:01.750828 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-c5307d67-bb0c-4822-8931-591f5e73d1a1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:46:01.758717 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-c5307d67-bb0c-4822-8931-591f5e73d1a1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:01.759180 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-c5307d67-bb0c-4822-8931-591f5e73d1a1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:01.760010 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-c5307d67-bb0c-4822-8931-591f5e73d1a1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:01.760446 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-c5307d67-bb0c-4822-8931-591f5e73d1a1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:01.911496 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-c5307d67-bb0c-4822-8931-591f5e73d1a1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:46:01.920712 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-c5307d67-bb0c-4822-8931-591f5e73d1a1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:46:01.922199 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-c5307d67-bb0c-4822-8931-591f5e73d1a1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:46:01.923368 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-c5307d67-bb0c-4822-8931-591f5e73d1a1 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926" status: 200 len: 1731 microversion: 2.20 time: 0.177361 Aug 01 16:46:01.923960 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 455/898] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:46:01 2022] GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926 => generated 1731 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:46:02.456263 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-b0e797f6-b106-402b-a216-b9dc25ba667b tempest-VolumesGetTestJSON-840255829 tempest-VolumesGetTestJSON-840255829-project] Calling method '.version_select at 0x7efd5ecb7430>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:46:02.514660 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-b0e797f6-b106-402b-a216-b9dc25ba667b tempest-VolumesGetTestJSON-840255829 tempest-VolumesGetTestJSON-840255829-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/fa43d89b-1ce4-42dc-b356-af91a0836fff" status: 200 len: 353 microversion: 2.1 time: 0.064126 Aug 01 16:46:02.523829 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 444/899] 10.222.0.45 () {58 vars in 1245 bytes} [Mon Aug 1 16:46:02 2022] GET /compute/v2.1/os-volumes/fa43d89b-1ce4-42dc-b356-af91a0836fff => generated 353 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 16:46:02.948037 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-6682942f-1286-4c83-92e5-8f027d1e68a3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:46:02.948717 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-6682942f-1286-4c83-92e5-8f027d1e68a3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:46:02.955840 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-6682942f-1286-4c83-92e5-8f027d1e68a3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:02.956290 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-6682942f-1286-4c83-92e5-8f027d1e68a3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:02.957076 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-6682942f-1286-4c83-92e5-8f027d1e68a3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:02.957501 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-6682942f-1286-4c83-92e5-8f027d1e68a3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:03.115902 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-6682942f-1286-4c83-92e5-8f027d1e68a3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:46:03.128731 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-6682942f-1286-4c83-92e5-8f027d1e68a3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:46:03.130940 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-6682942f-1286-4c83-92e5-8f027d1e68a3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:46:03.132141 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-6682942f-1286-4c83-92e5-8f027d1e68a3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926" status: 200 len: 1731 microversion: 2.20 time: 0.188149 Aug 01 16:46:03.132708 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 456/900] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:46:02 2022] GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926 => generated 1731 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:46:03.535532 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-c4f10d6b-1348-4c03-bce2-49de0cc813b9 tempest-VolumesGetTestJSON-840255829 tempest-VolumesGetTestJSON-840255829-project] Calling method '.version_select at 0x7efd5ec39160>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:46:03.607158 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-c4f10d6b-1348-4c03-bce2-49de0cc813b9 tempest-VolumesGetTestJSON-840255829 tempest-VolumesGetTestJSON-840255829-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/fa43d89b-1ce4-42dc-b356-af91a0836fff" status: 200 len: 353 microversion: 2.1 time: 0.077791 Aug 01 16:46:03.613085 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 445/901] 10.222.0.45 () {58 vars in 1245 bytes} [Mon Aug 1 16:46:03 2022] GET /compute/v2.1/os-volumes/fa43d89b-1ce4-42dc-b356-af91a0836fff => generated 353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:46:04.155982 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-9584733f-06e0-4f7a-83fb-1f4cb5729995 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:46:04.156601 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-9584733f-06e0-4f7a-83fb-1f4cb5729995 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:46:04.164019 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-9584733f-06e0-4f7a-83fb-1f4cb5729995 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:04.164464 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-9584733f-06e0-4f7a-83fb-1f4cb5729995 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:04.165221 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-9584733f-06e0-4f7a-83fb-1f4cb5729995 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:04.165642 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-9584733f-06e0-4f7a-83fb-1f4cb5729995 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:04.366698 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-9584733f-06e0-4f7a-83fb-1f4cb5729995 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:46:04.382839 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-9584733f-06e0-4f7a-83fb-1f4cb5729995 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:46:04.385880 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-9584733f-06e0-4f7a-83fb-1f4cb5729995 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:46:04.388299 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-9584733f-06e0-4f7a-83fb-1f4cb5729995 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926" status: 200 len: 1731 microversion: 2.20 time: 0.235924 Aug 01 16:46:04.389343 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 457/902] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:46:04 2022] GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926 => generated 1731 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:46:04.621790 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-f8b321a4-d99f-4849-9f7c-41e5eaac8d68 tempest-VolumesGetTestJSON-840255829 tempest-VolumesGetTestJSON-840255829-project] Calling method '.version_select at 0x7efd5ea4a160>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:46:04.678958 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-f8b321a4-d99f-4849-9f7c-41e5eaac8d68 tempest-VolumesGetTestJSON-840255829 tempest-VolumesGetTestJSON-840255829-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/fa43d89b-1ce4-42dc-b356-af91a0836fff" status: 200 len: 353 microversion: 2.1 time: 0.061230 Aug 01 16:46:04.680151 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 446/903] 10.222.0.45 () {58 vars in 1245 bytes} [Mon Aug 1 16:46:04 2022] GET /compute/v2.1/os-volumes/fa43d89b-1ce4-42dc-b356-af91a0836fff => generated 353 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:46:05.423925 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-58fbe24c-960b-492b-acdd-cf5f333b02a3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:46:05.424639 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-58fbe24c-960b-492b-acdd-cf5f333b02a3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:46:05.432194 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-58fbe24c-960b-492b-acdd-cf5f333b02a3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:05.432687 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-58fbe24c-960b-492b-acdd-cf5f333b02a3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:05.433507 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-58fbe24c-960b-492b-acdd-cf5f333b02a3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:05.433939 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-58fbe24c-960b-492b-acdd-cf5f333b02a3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:05.599625 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-58fbe24c-960b-492b-acdd-cf5f333b02a3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:46:05.613569 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-58fbe24c-960b-492b-acdd-cf5f333b02a3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:46:05.616116 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-58fbe24c-960b-492b-acdd-cf5f333b02a3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:46:05.617527 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-58fbe24c-960b-492b-acdd-cf5f333b02a3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926" status: 200 len: 1731 microversion: 2.20 time: 0.197628 Aug 01 16:46:05.618274 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 458/904] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:46:05 2022] GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926 => generated 1731 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:46:05.697819 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-0b04a5a9-ebf4-499c-b233-335721751407 tempest-VolumesGetTestJSON-840255829 tempest-VolumesGetTestJSON-840255829-project] Calling method '.version_select at 0x7efd5ef2cee0>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:46:05.744367 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [req-d9627684-e4ff-4e1b-9b6b-605431ddb417 req-5babb4a8-0eed-44bf-a6a7-8259db3df8a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "144c8e15-97cd-4e0d-9d60-2ba97c26e926", "name": "network-vif-plugged", "status": "completed", "tag": "4f59fd5b-8ef2-4634-a3a5-063fd9fa3526"}]} {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:46:05.763922 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-d9627684-e4ff-4e1b-9b6b-605431ddb417 req-5babb4a8-0eed-44bf-a6a7-8259db3df8a6 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:05.764359 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-d9627684-e4ff-4e1b-9b6b-605431ddb417 req-5babb4a8-0eed-44bf-a6a7-8259db3df8a6 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:05.780852 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.compute.server_external_events [req-d9627684-e4ff-4e1b-9b6b-605431ddb417 req-5babb4a8-0eed-44bf-a6a7-8259db3df8a6 service nova] Creating event network-vif-plugged:4f59fd5b-8ef2-4634-a3a5-063fd9fa3526 for instance 144c8e15-97cd-4e0d-9d60-2ba97c26e926 on hv-cinder-85032 Aug 01 16:46:05.788024 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [req-d9627684-e4ff-4e1b-9b6b-605431ddb417 req-5babb4a8-0eed-44bf-a6a7-8259db3df8a6 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047296 Aug 01 16:46:05.788631 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 459/905] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:46:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 16:46:05.791289 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-0b04a5a9-ebf4-499c-b233-335721751407 tempest-VolumesGetTestJSON-840255829 tempest-VolumesGetTestJSON-840255829-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/fa43d89b-1ce4-42dc-b356-af91a0836fff" status: 200 len: 354 microversion: 2.1 time: 0.099845 Aug 01 16:46:05.792521 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 447/906] 10.222.0.45 () {58 vars in 1245 bytes} [Mon Aug 1 16:46:05 2022] GET /compute/v2.1/os-volumes/fa43d89b-1ce4-42dc-b356-af91a0836fff => generated 354 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:46:05.806455 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-4acb56b0-58cb-4880-910c-3840b501b257 tempest-VolumesGetTestJSON-840255829 tempest-VolumesGetTestJSON-840255829-project] Calling method '.version_select at 0x7efd674d89d0>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:46:05.869943 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-4acb56b0-58cb-4880-910c-3840b501b257 tempest-VolumesGetTestJSON-840255829 tempest-VolumesGetTestJSON-840255829-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/fa43d89b-1ce4-42dc-b356-af91a0836fff" status: 200 len: 354 microversion: 2.1 time: 0.068054 Aug 01 16:46:05.870533 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 460/907] 10.222.0.45 () {58 vars in 1245 bytes} [Mon Aug 1 16:46:05 2022] GET /compute/v2.1/os-volumes/fa43d89b-1ce4-42dc-b356-af91a0836fff => generated 354 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:46:05.898367 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-a157aad7-0111-447c-b0e2-6c0da8f0d7b7 tempest-VolumesGetTestJSON-840255829 tempest-VolumesGetTestJSON-840255829-project] Calling method '.version_select at 0x7efd5eda31f0>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:46:05.979552 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-a157aad7-0111-447c-b0e2-6c0da8f0d7b7 tempest-VolumesGetTestJSON-840255829 tempest-VolumesGetTestJSON-840255829-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/fa43d89b-1ce4-42dc-b356-af91a0836fff" status: 202 len: 0 microversion: 2.1 time: 0.086202 Aug 01 16:46:05.981774 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 448/908] 10.222.0.45 () {58 vars in 1248 bytes} [Mon Aug 1 16:46:05 2022] DELETE /compute/v2.1/os-volumes/fa43d89b-1ce4-42dc-b356-af91a0836fff => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 01 16:46:05.998213 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-eddf7d5d-cccc-4a4e-9e01-52c101a6df6a tempest-VolumesGetTestJSON-840255829 tempest-VolumesGetTestJSON-840255829-project] Calling method '.version_select at 0x7efd67467c10>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:46:06.087177 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-eddf7d5d-cccc-4a4e-9e01-52c101a6df6a tempest-VolumesGetTestJSON-840255829 tempest-VolumesGetTestJSON-840255829-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/fa43d89b-1ce4-42dc-b356-af91a0836fff" status: 200 len: 353 microversion: 2.1 time: 0.099291 Aug 01 16:46:06.088052 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 461/909] 10.222.0.45 () {58 vars in 1245 bytes} [Mon Aug 1 16:46:05 2022] GET /compute/v2.1/os-volumes/fa43d89b-1ce4-42dc-b356-af91a0836fff => generated 353 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:46:06.642251 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-71985a5c-59ae-4fe4-a649-c66479bd5921 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:46:06.643101 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-71985a5c-59ae-4fe4-a649-c66479bd5921 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:46:06.645398 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=2 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:46:06.652491 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-71985a5c-59ae-4fe4-a649-c66479bd5921 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:06.652924 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-71985a5c-59ae-4fe4-a649-c66479bd5921 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:06.653680 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-71985a5c-59ae-4fe4-a649-c66479bd5921 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:06.654105 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-71985a5c-59ae-4fe4-a649-c66479bd5921 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:06.811284 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-71985a5c-59ae-4fe4-a649-c66479bd5921 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:46:06.821342 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-71985a5c-59ae-4fe4-a649-c66479bd5921 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:46:06.822919 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-71985a5c-59ae-4fe4-a649-c66479bd5921 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:46:06.824211 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-71985a5c-59ae-4fe4-a649-c66479bd5921 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926" status: 200 len: 1731 microversion: 2.20 time: 0.185864 Aug 01 16:46:06.824788 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 449/910] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:46:06 2022] GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926 => generated 1731 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:46:07.102904 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-36b3e777-0c78-427a-9d1f-ba0b8e4e8cf8 tempest-VolumesGetTestJSON-840255829 tempest-VolumesGetTestJSON-840255829-project] Calling method '.version_select at 0x7efd674f43a0>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:46:07.133921 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.wsgi [None req-36b3e777-0c78-427a-9d1f-ba0b8e4e8cf8 tempest-VolumesGetTestJSON-840255829 tempest-VolumesGetTestJSON-840255829-project] HTTP exception thrown: Volume fa43d89b-1ce4-42dc-b356-af91a0836fff could not be found. Aug 01 16:46:07.136507 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-36b3e777-0c78-427a-9d1f-ba0b8e4e8cf8 tempest-VolumesGetTestJSON-840255829 tempest-VolumesGetTestJSON-840255829-project] Request method failure captured: Aug 01 16:46:07.136507 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: request: GET /compute/v2.1/os-volumes/fa43d89b-1ce4-42dc-b356-af91a0836fff HTTP/1.1 Aug 01 16:46:07.136507 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Accept: application/json Aug 01 16:46:07.136507 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Accept-Encoding: identity Aug 01 16:46:07.136507 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Connection: close Aug 01 16:46:07.136507 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Content-Length: 0 Aug 01 16:46:07.136507 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Content-Type: application/json Aug 01 16:46:07.136507 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Host: 10.222.0.45 Aug 01 16:46:07.136507 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Openstack-System-Scope: None Aug 01 16:46:07.136507 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: User-Agent: python-urllib3/1.26.10 Aug 01 16:46:07.136507 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Auth-Token: gAAAAABi6ANIw58PHKWoLxdlCUS4QAMt_ZTSS_Bni9RUaesCREzxUwZf48wwWkrgZdKoPrkx8gWaJOF1En_GaSQYGEZAzmxM5EV8Dc18JQdA65SEC6qXOMCQf56MohlF4pJSs69aLKkOG4XaQx9ne6b9puuebmpit8qp1whzEACMetd_V-GKyeA Aug 01 16:46:07.136507 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Domain-Id: None Aug 01 16:46:07.136507 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Domain-Name: None Aug 01 16:46:07.136507 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Identity-Status: Confirmed Aug 01 16:46:07.136507 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Is-Admin-Project: True Aug 01 16:46:07.136507 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Domain-Id: default Aug 01 16:46:07.136507 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Domain-Name: Default Aug 01 16:46:07.136507 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Id: 3e7faeff1e5d4cdf9ad000fa6d756310 Aug 01 16:46:07.136507 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Name: tempest-VolumesGetTestJSON-840255829 Aug 01 16:46:07.136507 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Role: reader,member Aug 01 16:46:07.136507 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Roles: reader,member Aug 01 16:46:07.139379 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_3e7faeff1e5d4cdf9ad000fa6d756310"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/3e7faeff1e5d4cdf9ad000fa6d756310"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3e7faeff1e5d4cdf9ad000fa6d756310"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/3e7faeff1e5d4cdf9ad000fa6d756310"}]}] Aug 01 16:46:07.139379 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant: tempest-VolumesGetTestJSON-840255829 Aug 01 16:46:07.139379 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant-Id: 3e7faeff1e5d4cdf9ad000fa6d756310 Aug 01 16:46:07.139379 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant-Name: tempest-VolumesGetTestJSON-840255829 Aug 01 16:46:07.139379 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User: tempest-VolumesGetTestJSON-840255829-project Aug 01 16:46:07.139379 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Domain-Id: default Aug 01 16:46:07.139379 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Domain-Name: Default Aug 01 16:46:07.139379 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Id: 38ca26881d0a401ba725ba269f640902 Aug 01 16:46:07.139379 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Name: tempest-VolumesGetTestJSON-840255829-project Aug 01 16:46:07.139379 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: method: Aug 01 16:46:07.139379 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: exception: Volume fa43d89b-1ce4-42dc-b356-af91a0836fff could not be found. Aug 01 16:46:07.139379 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: action_args: {'id': 'fa43d89b-1ce4-42dc-b356-af91a0836fff'} Aug 01 16:46:07.139379 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:46:07.141223 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:46:07.141223 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 16:46:07.141223 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 16:46:07.141223 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 16:46:07.141223 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 16:46:07.141223 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 16:46:07.141223 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 16:46:07.141223 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 16:46:07.141223 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 16:46:07.141223 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 16:46:07.141223 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 16:46:07.141223 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 16:46:07.141223 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 16:46:07.141223 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 16:46:07.141223 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 16:46:07.141223 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fa43d89b-1ce4-42dc-b356-af91a0836fff could not be found. (HTTP 404) (Request-ID: req-deadddec-88cc-4ed6-8827-1f219b25698f) Aug 01 16:46:07.141223 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:46:07.141223 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:46:07.141223 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:46:07.143911 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:46:07.143911 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 01 16:46:07.143911 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 01 16:46:07.143911 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 16:46:07.143911 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 16:46:07.143911 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 16:46:07.143911 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 16:46:07.143911 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 16:46:07.143911 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 16:46:07.143911 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 16:46:07.143911 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 16:46:07.143911 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 16:46:07.143911 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 16:46:07.143911 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 16:46:07.143911 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 16:46:07.143911 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 16:46:07.143911 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 16:46:07.143911 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 16:46:07.143911 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 16:46:07.147539 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 16:46:07.147539 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 16:46:07.147539 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 16:46:07.147539 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 16:46:07.147539 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fa43d89b-1ce4-42dc-b356-af91a0836fff could not be found. Aug 01 16:46:07.147539 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:46:07.147539 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:46:07.147539 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:46:07.147539 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:46:07.147539 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:46:07.147539 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:46:07.147539 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:46:07.147539 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:46:07.147539 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 16:46:07.147539 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 16:46:07.147539 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:46:07.147539 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:46:07.147539 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 01 16:46:07.147539 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:46:07.150118 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fa43d89b-1ce4-42dc-b356-af91a0836fff could not be found. Aug 01 16:46:07.150118 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:46:07.150118 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:46:07.150118 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:46:07.150118 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:46:07.150118 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:46:07.150118 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:46:07.150118 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:46:07.150118 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:46:07.150118 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fa43d89b-1ce4-42dc-b356-af91a0836fff could not be found. Aug 01 16:46:07.150118 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:46:07.150118 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-36b3e777-0c78-427a-9d1f-ba0b8e4e8cf8 tempest-VolumesGetTestJSON-840255829 tempest-VolumesGetTestJSON-840255829-project] Returning 404 to user: Volume fa43d89b-1ce4-42dc-b356-af91a0836fff could not be found. {{(pid=118118) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:46:07.150118 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-36b3e777-0c78-427a-9d1f-ba0b8e4e8cf8 tempest-VolumesGetTestJSON-840255829 tempest-VolumesGetTestJSON-840255829-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/fa43d89b-1ce4-42dc-b356-af91a0836fff" status: 404 len: 109 microversion: 2.1 time: 0.039999 Aug 01 16:46:07.150118 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 462/911] 10.222.0.45 () {58 vars in 1245 bytes} [Mon Aug 1 16:46:07 2022] GET /compute/v2.1/os-volumes/fa43d89b-1ce4-42dc-b356-af91a0836fff => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 16:46:07.849591 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-237f3fb0-c929-4a6e-943c-ede633a81c96 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:46:07.850361 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-237f3fb0-c929-4a6e-943c-ede633a81c96 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:46:07.858035 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-237f3fb0-c929-4a6e-943c-ede633a81c96 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:07.858608 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-237f3fb0-c929-4a6e-943c-ede633a81c96 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:07.859463 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-237f3fb0-c929-4a6e-943c-ede633a81c96 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:07.859998 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-237f3fb0-c929-4a6e-943c-ede633a81c96 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:08.127539 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-237f3fb0-c929-4a6e-943c-ede633a81c96 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:46:08.152976 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-237f3fb0-c929-4a6e-943c-ede633a81c96 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:46:08.158220 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-237f3fb0-c929-4a6e-943c-ede633a81c96 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:46:08.161018 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-237f3fb0-c929-4a6e-943c-ede633a81c96 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926" status: 200 len: 1731 microversion: 2.20 time: 0.314355 Aug 01 16:46:08.164758 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 450/912] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:46:07 2022] GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926 => generated 1731 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:46:09.189969 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-79593bd9-cefe-4d9e-8e12-0162b7ea9a75 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:46:09.190702 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-79593bd9-cefe-4d9e-8e12-0162b7ea9a75 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:46:09.198422 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-79593bd9-cefe-4d9e-8e12-0162b7ea9a75 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:09.198967 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-79593bd9-cefe-4d9e-8e12-0162b7ea9a75 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:09.199641 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-79593bd9-cefe-4d9e-8e12-0162b7ea9a75 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:09.200101 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-79593bd9-cefe-4d9e-8e12-0162b7ea9a75 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:09.408168 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-79593bd9-cefe-4d9e-8e12-0162b7ea9a75 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:46:09.417010 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-79593bd9-cefe-4d9e-8e12-0162b7ea9a75 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:46:09.418496 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-79593bd9-cefe-4d9e-8e12-0162b7ea9a75 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:46:09.419652 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-79593bd9-cefe-4d9e-8e12-0162b7ea9a75 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926" status: 200 len: 1718 microversion: 2.20 time: 0.234186 Aug 01 16:46:09.420232 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 463/913] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:46:09 2022] GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926 => generated 1718 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:46:10.385160 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-a40bb534-ee11-4eea-9b1f-d7ade478dc45 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:46:10.385794 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-a40bb534-ee11-4eea-9b1f-d7ade478dc45 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] [instance: 45745fab-4299-4cef-a04a-619855e55336] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:46:10.393336 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-a40bb534-ee11-4eea-9b1f-d7ade478dc45 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:10.393752 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-a40bb534-ee11-4eea-9b1f-d7ade478dc45 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:10.394588 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-a40bb534-ee11-4eea-9b1f-d7ade478dc45 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:10.395149 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-a40bb534-ee11-4eea-9b1f-d7ade478dc45 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:10.436476 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-a40bb534-ee11-4eea-9b1f-d7ade478dc45 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] [instance: 45745fab-4299-4cef-a04a-619855e55336] Going to try to terminate instance {{(pid=118117) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 16:46:10.493097 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:46:10.574190 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-a40bb534-ee11-4eea-9b1f-d7ade478dc45 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] 10.222.0.45 "DELETE /compute/v2.1/servers/45745fab-4299-4cef-a04a-619855e55336" status: 204 len: 0 microversion: 2.1 time: 0.192811 Aug 01 16:46:10.574829 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 451/914] 10.222.0.45 () {58 vars in 1239 bytes} [Mon Aug 1 16:46:10 2022] DELETE /compute/v2.1/servers/45745fab-4299-4cef-a04a-619855e55336 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 16:46:10.584300 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-83e8a8cf-c45e-4bfe-a277-25f36a7e88e9 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:46:10.584915 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-83e8a8cf-c45e-4bfe-a277-25f36a7e88e9 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] [instance: 45745fab-4299-4cef-a04a-619855e55336] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:46:10.592047 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-83e8a8cf-c45e-4bfe-a277-25f36a7e88e9 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:10.592498 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-83e8a8cf-c45e-4bfe-a277-25f36a7e88e9 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:10.593263 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-83e8a8cf-c45e-4bfe-a277-25f36a7e88e9 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:10.593855 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-83e8a8cf-c45e-4bfe-a277-25f36a7e88e9 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:11.067913 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-83e8a8cf-c45e-4bfe-a277-25f36a7e88e9 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22cfd17a6f434deca7ef77253ae3ed2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86fcc5e23854dfba97058deac8211d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:46:11.079605 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-83e8a8cf-c45e-4bfe-a277-25f36a7e88e9 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] 10.222.0.45 "GET /compute/v2.1/servers/45745fab-4299-4cef-a04a-619855e55336" status: 200 len: 1577 microversion: 2.1 time: 0.499161 Aug 01 16:46:11.080499 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 464/915] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:46:10 2022] GET /compute/v2.1/servers/45745fab-4299-4cef-a04a-619855e55336 => generated 1577 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:46:12.112669 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-362c407a-4933-4fd6-ba8e-5795e7f5fa15 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:46:12.114544 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-362c407a-4933-4fd6-ba8e-5795e7f5fa15 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] [instance: 45745fab-4299-4cef-a04a-619855e55336] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:46:12.123960 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-362c407a-4933-4fd6-ba8e-5795e7f5fa15 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:12.124462 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-362c407a-4933-4fd6-ba8e-5795e7f5fa15 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:12.125938 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-362c407a-4933-4fd6-ba8e-5795e7f5fa15 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:12.126360 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-362c407a-4933-4fd6-ba8e-5795e7f5fa15 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:12.292551 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-362c407a-4933-4fd6-ba8e-5795e7f5fa15 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22cfd17a6f434deca7ef77253ae3ed2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86fcc5e23854dfba97058deac8211d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:46:12.303876 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-362c407a-4933-4fd6-ba8e-5795e7f5fa15 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] 10.222.0.45 "GET /compute/v2.1/servers/45745fab-4299-4cef-a04a-619855e55336" status: 200 len: 1577 microversion: 2.1 time: 0.196733 Aug 01 16:46:12.304479 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 452/916] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:46:12 2022] GET /compute/v2.1/servers/45745fab-4299-4cef-a04a-619855e55336 => generated 1577 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:46:13.331174 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-c576f8e4-a4b7-4116-9589-d7580c5c78e0 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:46:13.333353 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-c576f8e4-a4b7-4116-9589-d7580c5c78e0 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] [instance: 45745fab-4299-4cef-a04a-619855e55336] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:46:13.346754 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-c576f8e4-a4b7-4116-9589-d7580c5c78e0 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:13.348087 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-c576f8e4-a4b7-4116-9589-d7580c5c78e0 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:13.349982 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-c576f8e4-a4b7-4116-9589-d7580c5c78e0 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:13.351514 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-c576f8e4-a4b7-4116-9589-d7580c5c78e0 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:13.575473 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-c576f8e4-a4b7-4116-9589-d7580c5c78e0 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22cfd17a6f434deca7ef77253ae3ed2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86fcc5e23854dfba97058deac8211d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:46:13.596557 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-c576f8e4-a4b7-4116-9589-d7580c5c78e0 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] 10.222.0.45 "GET /compute/v2.1/servers/45745fab-4299-4cef-a04a-619855e55336" status: 200 len: 1509 microversion: 2.1 time: 0.272412 Aug 01 16:46:13.609543 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 465/917] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:46:13 2022] GET /compute/v2.1/servers/45745fab-4299-4cef-a04a-619855e55336 => generated 1509 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:46:13.610065 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [req-f41218b6-39c2-40cd-b98f-421b8dd59b10 req-428acd79-cdab-46a3-ab56-15886f3b950c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45745fab-4299-4cef-a04a-619855e55336", "name": "network-vif-deleted", "tag": "11c59797-892f-4432-9ed5-d068c34e65d5"}]} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:46:13.642774 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-f41218b6-39c2-40cd-b98f-421b8dd59b10 req-428acd79-cdab-46a3-ab56-15886f3b950c service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:13.643419 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-f41218b6-39c2-40cd-b98f-421b8dd59b10 req-428acd79-cdab-46a3-ab56-15886f3b950c service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:13.665400 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.compute.server_external_events [req-f41218b6-39c2-40cd-b98f-421b8dd59b10 req-428acd79-cdab-46a3-ab56-15886f3b950c service nova] Creating event network-vif-deleted:11c59797-892f-4432-9ed5-d068c34e65d5 for instance 45745fab-4299-4cef-a04a-619855e55336 on hv-cinder-85032 Aug 01 16:46:13.675883 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [req-f41218b6-39c2-40cd-b98f-421b8dd59b10 req-428acd79-cdab-46a3-ab56-15886f3b950c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071081 Aug 01 16:46:13.678317 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 453/918] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:46:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 16:46:14.631038 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-fa73c8c5-0873-4614-9ad7-8d95ee79dab3 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:46:14.631702 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-fa73c8c5-0873-4614-9ad7-8d95ee79dab3 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] [instance: 45745fab-4299-4cef-a04a-619855e55336] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:46:14.643817 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-fa73c8c5-0873-4614-9ad7-8d95ee79dab3 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:14.644364 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-fa73c8c5-0873-4614-9ad7-8d95ee79dab3 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:14.645187 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-fa73c8c5-0873-4614-9ad7-8d95ee79dab3 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:14.645622 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-fa73c8c5-0873-4614-9ad7-8d95ee79dab3 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:14.748534 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-fa73c8c5-0873-4614-9ad7-8d95ee79dab3 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22cfd17a6f434deca7ef77253ae3ed2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86fcc5e23854dfba97058deac8211d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:46:14.757046 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-fa73c8c5-0873-4614-9ad7-8d95ee79dab3 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] 10.222.0.45 "GET /compute/v2.1/servers/45745fab-4299-4cef-a04a-619855e55336" status: 200 len: 1226 microversion: 2.1 time: 0.130087 Aug 01 16:46:14.757626 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 466/919] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:46:14 2022] GET /compute/v2.1/servers/45745fab-4299-4cef-a04a-619855e55336 => generated 1226 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:46:15.779632 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-4e5b5848-1434-4f80-adce-f2b5a01b9b15 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:46:15.780501 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-4e5b5848-1434-4f80-adce-f2b5a01b9b15 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] [instance: 45745fab-4299-4cef-a04a-619855e55336] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:46:15.788809 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-4e5b5848-1434-4f80-adce-f2b5a01b9b15 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:15.789256 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-4e5b5848-1434-4f80-adce-f2b5a01b9b15 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:15.790041 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-4e5b5848-1434-4f80-adce-f2b5a01b9b15 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:15.790475 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-4e5b5848-1434-4f80-adce-f2b5a01b9b15 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:15.856633 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-4e5b5848-1434-4f80-adce-f2b5a01b9b15 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22cfd17a6f434deca7ef77253ae3ed2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86fcc5e23854dfba97058deac8211d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:46:15.864849 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-4e5b5848-1434-4f80-adce-f2b5a01b9b15 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] 10.222.0.45 "GET /compute/v2.1/servers/45745fab-4299-4cef-a04a-619855e55336" status: 200 len: 1226 microversion: 2.1 time: 0.089518 Aug 01 16:46:15.865461 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 454/920] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:46:15 2022] GET /compute/v2.1/servers/45745fab-4299-4cef-a04a-619855e55336 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:46:16.888000 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-f9232938-ed71-45f8-a1b5-71dd31c46af2 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:46:16.888817 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-f9232938-ed71-45f8-a1b5-71dd31c46af2 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] [instance: 45745fab-4299-4cef-a04a-619855e55336] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:46:16.901695 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-f9232938-ed71-45f8-a1b5-71dd31c46af2 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:16.902730 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-f9232938-ed71-45f8-a1b5-71dd31c46af2 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:16.904435 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-f9232938-ed71-45f8-a1b5-71dd31c46af2 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:16.905341 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-f9232938-ed71-45f8-a1b5-71dd31c46af2 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:16.951917 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-f9232938-ed71-45f8-a1b5-71dd31c46af2 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:16.952358 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-f9232938-ed71-45f8-a1b5-71dd31c46af2 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:16.952789 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.objects.instance [None req-f9232938-ed71-45f8-a1b5-71dd31c46af2 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lazy-loading 'fault' on Instance uuid 45745fab-4299-4cef-a04a-619855e55336 {{(pid=118118) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 16:46:17.005898 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-f9232938-ed71-45f8-a1b5-71dd31c46af2 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22cfd17a6f434deca7ef77253ae3ed2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86fcc5e23854dfba97058deac8211d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:46:17.014322 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-f9232938-ed71-45f8-a1b5-71dd31c46af2 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] 10.222.0.45 "GET /compute/v2.1/servers/45745fab-4299-4cef-a04a-619855e55336" status: 200 len: 1231 microversion: 2.1 time: 0.131520 Aug 01 16:46:17.014952 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 467/921] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:46:16 2022] GET /compute/v2.1/servers/45745fab-4299-4cef-a04a-619855e55336 => generated 1231 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:46:18.037322 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-3c5be69c-6d48-407d-91e5-a7a82f2c4eae tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:46:18.037904 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-3c5be69c-6d48-407d-91e5-a7a82f2c4eae tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] [instance: 45745fab-4299-4cef-a04a-619855e55336] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:46:18.045256 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-3c5be69c-6d48-407d-91e5-a7a82f2c4eae tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:18.045704 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-3c5be69c-6d48-407d-91e5-a7a82f2c4eae tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:18.046485 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-3c5be69c-6d48-407d-91e5-a7a82f2c4eae tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:18.046940 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-3c5be69c-6d48-407d-91e5-a7a82f2c4eae tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:18.062509 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.wsgi [None req-3c5be69c-6d48-407d-91e5-a7a82f2c4eae tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] HTTP exception thrown: Instance 45745fab-4299-4cef-a04a-619855e55336 could not be found. Aug 01 16:46:18.064234 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-3c5be69c-6d48-407d-91e5-a7a82f2c4eae tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Request method failure captured: Aug 01 16:46:18.064234 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: request: GET /compute/v2.1/servers/45745fab-4299-4cef-a04a-619855e55336 HTTP/1.1 Aug 01 16:46:18.064234 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Accept: application/json Aug 01 16:46:18.064234 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Accept-Encoding: identity Aug 01 16:46:18.064234 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Connection: close Aug 01 16:46:18.064234 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Content-Length: 0 Aug 01 16:46:18.064234 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Content-Type: application/json Aug 01 16:46:18.064234 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Host: 10.222.0.45 Aug 01 16:46:18.064234 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Openstack-System-Scope: None Aug 01 16:46:18.064234 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: User-Agent: python-urllib3/1.26.10 Aug 01 16:46:18.064234 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Auth-Token: gAAAAABi6AKg8WmNwxCzvUjnoYA4FQHTxGwQvRdtB15M_AzfpDwZRSzODKfCo8aZ73Vjzj_qNkr77n7SZvW2FlrhpR3Gt34j8pB4XND9OfvN9vCqhBluiWD5-AMypzHSpaMRI3kZBLXVbAvlHpVHhGWg7H4X9yfBmfNdCySNXS6ys69JLd5AYAc Aug 01 16:46:18.064234 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Domain-Id: None Aug 01 16:46:18.064234 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Domain-Name: None Aug 01 16:46:18.064234 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Identity-Status: Confirmed Aug 01 16:46:18.064234 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Is-Admin-Project: True Aug 01 16:46:18.064234 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Domain-Id: default Aug 01 16:46:18.064234 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Domain-Name: Default Aug 01 16:46:18.064234 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Id: c86fcc5e23854dfba97058deac8211d0 Aug 01 16:46:18.064234 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Name: tempest-TestVolumeBootPattern-1374329435 Aug 01 16:46:18.064234 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Role: reader,member Aug 01 16:46:18.064234 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Roles: reader,member Aug 01 16:46:18.065636 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c86fcc5e23854dfba97058deac8211d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c86fcc5e23854dfba97058deac8211d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c86fcc5e23854dfba97058deac8211d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c86fcc5e23854dfba97058deac8211d0"}]}] Aug 01 16:46:18.065636 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Tenant: tempest-TestVolumeBootPattern-1374329435 Aug 01 16:46:18.065636 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Tenant-Id: c86fcc5e23854dfba97058deac8211d0 Aug 01 16:46:18.065636 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Tenant-Name: tempest-TestVolumeBootPattern-1374329435 Aug 01 16:46:18.065636 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User: tempest-TestVolumeBootPattern-1374329435-project Aug 01 16:46:18.065636 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Domain-Id: default Aug 01 16:46:18.065636 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Domain-Name: Default Aug 01 16:46:18.065636 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Id: 22cfd17a6f434deca7ef77253ae3ed2f Aug 01 16:46:18.065636 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Name: tempest-TestVolumeBootPattern-1374329435-project Aug 01 16:46:18.065636 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: method: > Aug 01 16:46:18.065636 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: exception: Instance 45745fab-4299-4cef-a04a-619855e55336 could not be found. Aug 01 16:46:18.065636 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: action_args: {'id': '45745fab-4299-4cef-a04a-619855e55336'} Aug 01 16:46:18.066606 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:46:18.066606 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:46:18.066606 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 16:46:18.066606 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 16:46:18.066606 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 16:46:18.066606 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 16:46:18.066606 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 16:46:18.066606 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 16:46:18.066606 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 16:46:18.066606 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 16:46:18.066606 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45745fab-4299-4cef-a04a-619855e55336 could not be found. Aug 01 16:46:18.066606 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:46:18.066606 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:46:18.066606 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:46:18.066606 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:46:18.066606 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:46:18.066606 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:46:18.066606 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:46:18.066606 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:46:18.066606 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:46:18.069704 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:46:18.069704 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 16:46:18.069704 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 16:46:18.069704 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 16:46:18.069704 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 16:46:18.069704 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 16:46:18.069704 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:46:18.069704 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45745fab-4299-4cef-a04a-619855e55336 could not be found. Aug 01 16:46:18.069704 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:46:18.069704 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:46:18.069704 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:46:18.069704 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:46:18.069704 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:46:18.069704 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:46:18.069704 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:46:18.069704 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:46:18.069704 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45745fab-4299-4cef-a04a-619855e55336 could not be found. Aug 01 16:46:18.069704 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:46:18.072708 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-3c5be69c-6d48-407d-91e5-a7a82f2c4eae tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Returning 404 to user: Instance 45745fab-4299-4cef-a04a-619855e55336 could not be found. {{(pid=118117) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:46:18.072708 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-3c5be69c-6d48-407d-91e5-a7a82f2c4eae tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] 10.222.0.45 "GET /compute/v2.1/servers/45745fab-4299-4cef-a04a-619855e55336" status: 404 len: 111 microversion: 2.1 time: 0.032613 Aug 01 16:46:18.072708 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 455/922] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:46:18 2022] GET /compute/v2.1/servers/45745fab-4299-4cef-a04a-619855e55336 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 16:46:18.180656 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-f68324d2-c1f6-4990-889f-961ecfe71ab0 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1024463856", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1173141553", "security_groups": [{"name": "tempest-secgroup-smoke-1642957585"}], "block_device_mapping_v2": [{"uuid": "ea4adc0e-ba04-4687-8426-016d95e5ab3b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f2f38df7-15f3-4c49-abb4-95c1ce8da0a5"}]}} {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:46:18.307391 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.network.neutron [None req-f68324d2-c1f6-4990-889f-961ecfe71ab0 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] validate_networks() for [('f2f38df7-15f3-4c49-abb4-95c1ce8da0a5', None, None, None, None, None)] {{(pid=118118) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 16:46:18.883737 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.virt.hardware [None req-f68324d2-c1f6-4990-889f-961ecfe71ab0 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Flavor limits 0:0:0 {{(pid=118118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 16:46:18.884182 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.virt.hardware [None req-f68324d2-c1f6-4990-889f-961ecfe71ab0 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Image limits 0:0:0 {{(pid=118118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 16:46:18.884659 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.virt.hardware [None req-f68324d2-c1f6-4990-889f-961ecfe71ab0 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Flavor pref 0:0:0 {{(pid=118118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 16:46:18.885279 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.virt.hardware [None req-f68324d2-c1f6-4990-889f-961ecfe71ab0 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Image pref 0:0:0 {{(pid=118118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 16:46:18.885691 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.virt.hardware [None req-f68324d2-c1f6-4990-889f-961ecfe71ab0 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 16:46:18.895306 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-f68324d2-c1f6-4990-889f-961ecfe71ab0 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:18.895753 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-f68324d2-c1f6-4990-889f-961ecfe71ab0 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:18.896580 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-f68324d2-c1f6-4990-889f-961ecfe71ab0 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:18.897013 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-f68324d2-c1f6-4990-889f-961ecfe71ab0 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:18.924233 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.quota [None req-f68324d2-c1f6-4990-889f-961ecfe71ab0 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Getting quotas for project c86fcc5e23854dfba97058deac8211d0. Resources: {'cores', 'ram', 'instances'} {{(pid=118118) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 16:46:18.932173 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.quota [None req-f68324d2-c1f6-4990-889f-961ecfe71ab0 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Getting quotas for user 22cfd17a6f434deca7ef77253ae3ed2f and project c86fcc5e23854dfba97058deac8211d0. Resources: {'cores', 'ram', 'instances'} {{(pid=118118) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 16:46:19.050288 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-f68324d2-c1f6-4990-889f-961ecfe71ab0 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Going to run 1 instances... {{(pid=118118) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 16:46:19.052824 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-f68324d2-c1f6-4990-889f-961ecfe71ab0 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] [instance: 217725d8-74b1-41e3-b843-83904b818755] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ea4adc0e-ba04-4687-8426-016d95e5ab3b',volume_size=None,volume_type=None)] {{(pid=118118) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 16:46:19.246997 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-f68324d2-c1f6-4990-889f-961ecfe71ab0 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.070624 Aug 01 16:46:19.247923 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 468/923] 10.222.0.45 () {60 vars in 1147 bytes} [Mon Aug 1 16:46:18 2022] POST /compute/v2.1/servers => generated 406 bytes in 1072 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 16:46:19.259231 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-f6a3eccb-bafd-47c6-9b60-fae74161ea40 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:46:19.260093 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-f6a3eccb-bafd-47c6-9b60-fae74161ea40 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] [instance: 217725d8-74b1-41e3-b843-83904b818755] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:46:19.326191 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-f6a3eccb-bafd-47c6-9b60-fae74161ea40 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22cfd17a6f434deca7ef77253ae3ed2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86fcc5e23854dfba97058deac8211d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:46:19.336668 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-f6a3eccb-bafd-47c6-9b60-fae74161ea40 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] 10.222.0.45 "GET /compute/v2.1/servers/217725d8-74b1-41e3-b843-83904b818755" status: 200 len: 1095 microversion: 2.1 time: 0.081124 Aug 01 16:46:19.337287 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 456/924] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:46:19 2022] GET /compute/v2.1/servers/217725d8-74b1-41e3-b843-83904b818755 => generated 1095 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:46:20.361274 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-48b7d690-3192-4dff-9199-0bc2ba7351b6 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:46:20.361865 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-48b7d690-3192-4dff-9199-0bc2ba7351b6 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] [instance: 217725d8-74b1-41e3-b843-83904b818755] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:46:20.381103 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-48b7d690-3192-4dff-9199-0bc2ba7351b6 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:20.381792 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-48b7d690-3192-4dff-9199-0bc2ba7351b6 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:20.382686 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-48b7d690-3192-4dff-9199-0bc2ba7351b6 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:20.383122 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-48b7d690-3192-4dff-9199-0bc2ba7351b6 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:20.533711 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-48b7d690-3192-4dff-9199-0bc2ba7351b6 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22cfd17a6f434deca7ef77253ae3ed2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86fcc5e23854dfba97058deac8211d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:46:20.547980 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-48b7d690-3192-4dff-9199-0bc2ba7351b6 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] 10.222.0.45 "GET /compute/v2.1/servers/217725d8-74b1-41e3-b843-83904b818755" status: 200 len: 1201 microversion: 2.1 time: 0.192216 Aug 01 16:46:20.560018 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 469/925] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:46:20 2022] GET /compute/v2.1/servers/217725d8-74b1-41e3-b843-83904b818755 => generated 1201 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:46:21.574465 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-e3f9b2b8-7e1b-4884-a1c6-ff44394be77a tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:46:21.575783 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-e3f9b2b8-7e1b-4884-a1c6-ff44394be77a tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] [instance: 217725d8-74b1-41e3-b843-83904b818755] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:46:21.583837 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-e3f9b2b8-7e1b-4884-a1c6-ff44394be77a tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:21.584366 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-e3f9b2b8-7e1b-4884-a1c6-ff44394be77a tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:21.585201 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-e3f9b2b8-7e1b-4884-a1c6-ff44394be77a tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:21.585678 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-e3f9b2b8-7e1b-4884-a1c6-ff44394be77a tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:21.876258 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-e3f9b2b8-7e1b-4884-a1c6-ff44394be77a tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22cfd17a6f434deca7ef77253ae3ed2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86fcc5e23854dfba97058deac8211d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:46:21.884508 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-e3f9b2b8-7e1b-4884-a1c6-ff44394be77a tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] 10.222.0.45 "GET /compute/v2.1/servers/217725d8-74b1-41e3-b843-83904b818755" status: 200 len: 1267 microversion: 2.1 time: 0.314077 Aug 01 16:46:21.885098 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 457/926] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:46:21 2022] GET /compute/v2.1/servers/217725d8-74b1-41e3-b843-83904b818755 => generated 1267 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:46:22.529570 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [req-d971f7a3-881b-42c1-a07d-1ec08952757b req-86dac4b6-0964-4440-8568-9e4403955bb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "217725d8-74b1-41e3-b843-83904b818755", "tag": "36b424b9-b58b-402c-926b-0bb6a125aa3a"}]} {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:46:22.544958 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-d971f7a3-881b-42c1-a07d-1ec08952757b req-86dac4b6-0964-4440-8568-9e4403955bb6 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:22.545760 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-d971f7a3-881b-42c1-a07d-1ec08952757b req-86dac4b6-0964-4440-8568-9e4403955bb6 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:22.569849 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.compute.server_external_events [req-d971f7a3-881b-42c1-a07d-1ec08952757b req-86dac4b6-0964-4440-8568-9e4403955bb6 service nova] Creating event network-changed:36b424b9-b58b-402c-926b-0bb6a125aa3a for instance 217725d8-74b1-41e3-b843-83904b818755 on hv-cinder-85032 Aug 01 16:46:22.576902 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [req-d971f7a3-881b-42c1-a07d-1ec08952757b req-86dac4b6-0964-4440-8568-9e4403955bb6 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054029 Aug 01 16:46:22.577664 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 470/927] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:46:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:46:22.908178 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-b1f28f28-6dfb-4044-a221-6398405323d1 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:46:22.909037 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-b1f28f28-6dfb-4044-a221-6398405323d1 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] [instance: 217725d8-74b1-41e3-b843-83904b818755] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:46:22.916861 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-b1f28f28-6dfb-4044-a221-6398405323d1 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:22.917308 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-b1f28f28-6dfb-4044-a221-6398405323d1 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:22.918353 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-b1f28f28-6dfb-4044-a221-6398405323d1 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:22.918945 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-b1f28f28-6dfb-4044-a221-6398405323d1 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:23.118756 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-b1f28f28-6dfb-4044-a221-6398405323d1 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22cfd17a6f434deca7ef77253ae3ed2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86fcc5e23854dfba97058deac8211d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:46:23.127468 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-b1f28f28-6dfb-4044-a221-6398405323d1 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] 10.222.0.45 "GET /compute/v2.1/servers/217725d8-74b1-41e3-b843-83904b818755" status: 200 len: 1267 microversion: 2.1 time: 0.224325 Aug 01 16:46:23.128192 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 458/928] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:46:22 2022] GET /compute/v2.1/servers/217725d8-74b1-41e3-b843-83904b818755 => generated 1267 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:46:24.149486 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-6976dd3c-1437-4321-afed-55c69c4da12c tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:46:24.150318 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-6976dd3c-1437-4321-afed-55c69c4da12c tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] [instance: 217725d8-74b1-41e3-b843-83904b818755] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:46:24.157282 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-6976dd3c-1437-4321-afed-55c69c4da12c tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:24.157733 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-6976dd3c-1437-4321-afed-55c69c4da12c tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:24.158694 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-6976dd3c-1437-4321-afed-55c69c4da12c tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:24.159124 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-6976dd3c-1437-4321-afed-55c69c4da12c tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:24.309962 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-6976dd3c-1437-4321-afed-55c69c4da12c tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22cfd17a6f434deca7ef77253ae3ed2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86fcc5e23854dfba97058deac8211d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:46:24.327276 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-6976dd3c-1437-4321-afed-55c69c4da12c tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] 10.222.0.45 "GET /compute/v2.1/servers/217725d8-74b1-41e3-b843-83904b818755" status: 200 len: 1267 microversion: 2.1 time: 0.181935 Aug 01 16:46:24.327919 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 471/929] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:46:24 2022] GET /compute/v2.1/servers/217725d8-74b1-41e3-b843-83904b818755 => generated 1267 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:46:25.350200 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-8870cff3-7021-463a-b5ed-76059e4f2028 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:46:25.350772 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-8870cff3-7021-463a-b5ed-76059e4f2028 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] [instance: 217725d8-74b1-41e3-b843-83904b818755] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:46:25.357848 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-8870cff3-7021-463a-b5ed-76059e4f2028 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:25.358290 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-8870cff3-7021-463a-b5ed-76059e4f2028 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:25.359068 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-8870cff3-7021-463a-b5ed-76059e4f2028 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:25.359501 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-8870cff3-7021-463a-b5ed-76059e4f2028 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:25.513653 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-8870cff3-7021-463a-b5ed-76059e4f2028 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22cfd17a6f434deca7ef77253ae3ed2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86fcc5e23854dfba97058deac8211d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:46:25.522496 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-8870cff3-7021-463a-b5ed-76059e4f2028 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] 10.222.0.45 "GET /compute/v2.1/servers/217725d8-74b1-41e3-b843-83904b818755" status: 200 len: 1267 microversion: 2.1 time: 0.176416 Aug 01 16:46:25.523105 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 459/930] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:46:25 2022] GET /compute/v2.1/servers/217725d8-74b1-41e3-b843-83904b818755 => generated 1267 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:46:26.552871 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-43408d1c-0824-4fd2-9e75-d5760541197e tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:46:26.553702 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-43408d1c-0824-4fd2-9e75-d5760541197e tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] [instance: 217725d8-74b1-41e3-b843-83904b818755] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:46:26.562837 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-43408d1c-0824-4fd2-9e75-d5760541197e tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:26.563834 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-43408d1c-0824-4fd2-9e75-d5760541197e tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:26.564747 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-43408d1c-0824-4fd2-9e75-d5760541197e tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:26.565272 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-43408d1c-0824-4fd2-9e75-d5760541197e tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:26.760215 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-43408d1c-0824-4fd2-9e75-d5760541197e tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22cfd17a6f434deca7ef77253ae3ed2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86fcc5e23854dfba97058deac8211d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:46:26.762667 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_cell1:SELECT=91 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:46:26.773608 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-43408d1c-0824-4fd2-9e75-d5760541197e tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] 10.222.0.45 "GET /compute/v2.1/servers/217725d8-74b1-41e3-b843-83904b818755" status: 200 len: 1267 microversion: 2.1 time: 0.233592 Aug 01 16:46:26.774518 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 472/931] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:46:26 2022] GET /compute/v2.1/servers/217725d8-74b1-41e3-b843-83904b818755 => generated 1267 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:46:27.794671 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-dd1763cb-a150-4023-a2b6-9be15970dc84 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:46:27.795297 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-dd1763cb-a150-4023-a2b6-9be15970dc84 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] [instance: 217725d8-74b1-41e3-b843-83904b818755] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:46:27.803209 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-dd1763cb-a150-4023-a2b6-9be15970dc84 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:27.803667 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-dd1763cb-a150-4023-a2b6-9be15970dc84 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:27.804567 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-dd1763cb-a150-4023-a2b6-9be15970dc84 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:27.805040 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-dd1763cb-a150-4023-a2b6-9be15970dc84 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:27.968223 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-dd1763cb-a150-4023-a2b6-9be15970dc84 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22cfd17a6f434deca7ef77253ae3ed2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86fcc5e23854dfba97058deac8211d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:46:27.969823 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-dd1763cb-a150-4023-a2b6-9be15970dc84 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] 10.222.0.45 "GET /compute/v2.1/servers/217725d8-74b1-41e3-b843-83904b818755" status: 200 len: 1267 microversion: 2.1 time: 0.179121 Aug 01 16:46:27.970628 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 460/932] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:46:27 2022] GET /compute/v2.1/servers/217725d8-74b1-41e3-b843-83904b818755 => generated 1267 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:46:28.993633 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-be2cc2a0-1ed5-426a-9dd1-fbdf7e7359cf tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:46:28.995423 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-be2cc2a0-1ed5-426a-9dd1-fbdf7e7359cf tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] [instance: 217725d8-74b1-41e3-b843-83904b818755] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:46:29.001166 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_cell0:SELECT=2 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:46:29.001938 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_cell0:SELECT=6 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:46:29.002638 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:46:29.007608 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-be2cc2a0-1ed5-426a-9dd1-fbdf7e7359cf tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:29.008245 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-be2cc2a0-1ed5-426a-9dd1-fbdf7e7359cf tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:29.009527 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-be2cc2a0-1ed5-426a-9dd1-fbdf7e7359cf tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:29.009964 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-be2cc2a0-1ed5-426a-9dd1-fbdf7e7359cf tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:29.159988 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-be2cc2a0-1ed5-426a-9dd1-fbdf7e7359cf tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22cfd17a6f434deca7ef77253ae3ed2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86fcc5e23854dfba97058deac8211d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:46:29.167975 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-be2cc2a0-1ed5-426a-9dd1-fbdf7e7359cf tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] 10.222.0.45 "GET /compute/v2.1/servers/217725d8-74b1-41e3-b843-83904b818755" status: 200 len: 1267 microversion: 2.1 time: 0.180336 Aug 01 16:46:29.168786 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 473/933] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:46:28 2022] GET /compute/v2.1/servers/217725d8-74b1-41e3-b843-83904b818755 => generated 1267 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:46:30.190363 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-38c66b2a-1506-48db-b81e-8df637ca0370 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:46:30.191035 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-38c66b2a-1506-48db-b81e-8df637ca0370 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] [instance: 217725d8-74b1-41e3-b843-83904b818755] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:46:30.194258 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_cell0:SELECT=2 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:46:30.200083 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-38c66b2a-1506-48db-b81e-8df637ca0370 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:30.200518 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-38c66b2a-1506-48db-b81e-8df637ca0370 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:30.201303 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-38c66b2a-1506-48db-b81e-8df637ca0370 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:30.201864 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-38c66b2a-1506-48db-b81e-8df637ca0370 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:30.344720 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-38c66b2a-1506-48db-b81e-8df637ca0370 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22cfd17a6f434deca7ef77253ae3ed2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86fcc5e23854dfba97058deac8211d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:46:30.352632 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-38c66b2a-1506-48db-b81e-8df637ca0370 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] 10.222.0.45 "GET /compute/v2.1/servers/217725d8-74b1-41e3-b843-83904b818755" status: 200 len: 1267 microversion: 2.1 time: 0.166532 Aug 01 16:46:30.353198 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 461/934] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:46:30 2022] GET /compute/v2.1/servers/217725d8-74b1-41e3-b843-83904b818755 => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:46:31.374453 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-9c7d709c-794e-40e1-b480-04b0c6aba0ad tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:46:31.375045 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-9c7d709c-794e-40e1-b480-04b0c6aba0ad tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] [instance: 217725d8-74b1-41e3-b843-83904b818755] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:46:31.382284 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-9c7d709c-794e-40e1-b480-04b0c6aba0ad tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:31.382702 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-9c7d709c-794e-40e1-b480-04b0c6aba0ad tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:31.383490 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-9c7d709c-794e-40e1-b480-04b0c6aba0ad tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:31.383997 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-9c7d709c-794e-40e1-b480-04b0c6aba0ad tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:31.526328 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-9c7d709c-794e-40e1-b480-04b0c6aba0ad tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22cfd17a6f434deca7ef77253ae3ed2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86fcc5e23854dfba97058deac8211d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:46:31.533932 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-9c7d709c-794e-40e1-b480-04b0c6aba0ad tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] 10.222.0.45 "GET /compute/v2.1/servers/217725d8-74b1-41e3-b843-83904b818755" status: 200 len: 1267 microversion: 2.1 time: 0.163436 Aug 01 16:46:31.534500 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 474/935] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:46:31 2022] GET /compute/v2.1/servers/217725d8-74b1-41e3-b843-83904b818755 => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:46:32.558135 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-12d0c5ba-6199-4843-b62e-0ee580dd6d77 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:46:32.558912 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-12d0c5ba-6199-4843-b62e-0ee580dd6d77 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] [instance: 217725d8-74b1-41e3-b843-83904b818755] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:46:32.567564 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-12d0c5ba-6199-4843-b62e-0ee580dd6d77 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:32.568015 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-12d0c5ba-6199-4843-b62e-0ee580dd6d77 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:32.568802 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-12d0c5ba-6199-4843-b62e-0ee580dd6d77 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:32.569237 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-12d0c5ba-6199-4843-b62e-0ee580dd6d77 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:32.746222 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-12d0c5ba-6199-4843-b62e-0ee580dd6d77 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22cfd17a6f434deca7ef77253ae3ed2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86fcc5e23854dfba97058deac8211d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:46:32.754990 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-12d0c5ba-6199-4843-b62e-0ee580dd6d77 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] 10.222.0.45 "GET /compute/v2.1/servers/217725d8-74b1-41e3-b843-83904b818755" status: 200 len: 1267 microversion: 2.1 time: 0.202248 Aug 01 16:46:32.755736 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 462/936] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:46:32 2022] GET /compute/v2.1/servers/217725d8-74b1-41e3-b843-83904b818755 => generated 1267 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:46:33.775993 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-7aa3b0dd-392d-4022-b3d0-4a3205dd84b2 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:46:33.777154 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-7aa3b0dd-392d-4022-b3d0-4a3205dd84b2 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] [instance: 217725d8-74b1-41e3-b843-83904b818755] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:46:33.784735 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-7aa3b0dd-392d-4022-b3d0-4a3205dd84b2 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:33.785279 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-7aa3b0dd-392d-4022-b3d0-4a3205dd84b2 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:33.786098 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-7aa3b0dd-392d-4022-b3d0-4a3205dd84b2 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:33.786528 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-7aa3b0dd-392d-4022-b3d0-4a3205dd84b2 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:33.883092 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [req-caece381-21c2-42db-a83f-5f65e88cf843 req-f175236b-082b-4059-8a12-c2906a532815 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "217725d8-74b1-41e3-b843-83904b818755", "name": "network-vif-plugged", "status": "completed", "tag": "36b424b9-b58b-402c-926b-0bb6a125aa3a"}]} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:46:33.900391 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-caece381-21c2-42db-a83f-5f65e88cf843 req-f175236b-082b-4059-8a12-c2906a532815 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:33.901198 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-caece381-21c2-42db-a83f-5f65e88cf843 req-f175236b-082b-4059-8a12-c2906a532815 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:33.921387 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.compute.server_external_events [req-caece381-21c2-42db-a83f-5f65e88cf843 req-f175236b-082b-4059-8a12-c2906a532815 service nova] Creating event network-vif-plugged:36b424b9-b58b-402c-926b-0bb6a125aa3a for instance 217725d8-74b1-41e3-b843-83904b818755 on hv-cinder-85032 Aug 01 16:46:33.930683 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [req-caece381-21c2-42db-a83f-5f65e88cf843 req-f175236b-082b-4059-8a12-c2906a532815 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050675 Aug 01 16:46:33.932157 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 463/937] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:46:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:46:34.022250 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-7aa3b0dd-392d-4022-b3d0-4a3205dd84b2 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22cfd17a6f434deca7ef77253ae3ed2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86fcc5e23854dfba97058deac8211d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:46:34.031669 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-7aa3b0dd-392d-4022-b3d0-4a3205dd84b2 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] 10.222.0.45 "GET /compute/v2.1/servers/217725d8-74b1-41e3-b843-83904b818755" status: 200 len: 1267 microversion: 2.1 time: 0.259390 Aug 01 16:46:34.032308 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 475/938] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:46:33 2022] GET /compute/v2.1/servers/217725d8-74b1-41e3-b843-83904b818755 => generated 1267 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:46:35.055732 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-d9bfbd52-4a31-4a01-8600-bafebbedae82 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:46:35.056476 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-d9bfbd52-4a31-4a01-8600-bafebbedae82 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] [instance: 217725d8-74b1-41e3-b843-83904b818755] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:46:35.063740 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-d9bfbd52-4a31-4a01-8600-bafebbedae82 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:35.064118 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-d9bfbd52-4a31-4a01-8600-bafebbedae82 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:35.064887 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-d9bfbd52-4a31-4a01-8600-bafebbedae82 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:35.065324 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-d9bfbd52-4a31-4a01-8600-bafebbedae82 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:35.208611 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-d9bfbd52-4a31-4a01-8600-bafebbedae82 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22cfd17a6f434deca7ef77253ae3ed2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86fcc5e23854dfba97058deac8211d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:46:35.217085 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-d9bfbd52-4a31-4a01-8600-bafebbedae82 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] 10.222.0.45 "GET /compute/v2.1/servers/217725d8-74b1-41e3-b843-83904b818755" status: 200 len: 1267 microversion: 2.1 time: 0.166500 Aug 01 16:46:35.217980 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 464/939] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:46:35 2022] GET /compute/v2.1/servers/217725d8-74b1-41e3-b843-83904b818755 => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:46:36.237830 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-8ead3575-a765-4033-af82-1f58952e4d1f tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:46:36.238427 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-8ead3575-a765-4033-af82-1f58952e4d1f tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] [instance: 217725d8-74b1-41e3-b843-83904b818755] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:46:36.245364 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-8ead3575-a765-4033-af82-1f58952e4d1f tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:36.245866 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-8ead3575-a765-4033-af82-1f58952e4d1f tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:36.246617 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-8ead3575-a765-4033-af82-1f58952e4d1f tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:36.247412 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-8ead3575-a765-4033-af82-1f58952e4d1f tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:36.399581 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-8ead3575-a765-4033-af82-1f58952e4d1f tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22cfd17a6f434deca7ef77253ae3ed2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86fcc5e23854dfba97058deac8211d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:46:36.407702 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-8ead3575-a765-4033-af82-1f58952e4d1f tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] 10.222.0.45 "GET /compute/v2.1/servers/217725d8-74b1-41e3-b843-83904b818755" status: 200 len: 1267 microversion: 2.1 time: 0.173803 Aug 01 16:46:36.408567 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 476/940] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:46:36 2022] GET /compute/v2.1/servers/217725d8-74b1-41e3-b843-83904b818755 => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:46:37.429721 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-ebe3cc19-2b6e-44de-9dfc-af9927f87273 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:46:37.430484 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-ebe3cc19-2b6e-44de-9dfc-af9927f87273 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] [instance: 217725d8-74b1-41e3-b843-83904b818755] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:46:37.444169 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:46:37.444169 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-ebe3cc19-2b6e-44de-9dfc-af9927f87273 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:37.444169 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-ebe3cc19-2b6e-44de-9dfc-af9927f87273 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:37.444169 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-ebe3cc19-2b6e-44de-9dfc-af9927f87273 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:37.444836 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-ebe3cc19-2b6e-44de-9dfc-af9927f87273 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:37.606392 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-ebe3cc19-2b6e-44de-9dfc-af9927f87273 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22cfd17a6f434deca7ef77253ae3ed2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86fcc5e23854dfba97058deac8211d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:46:37.614129 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-ebe3cc19-2b6e-44de-9dfc-af9927f87273 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] 10.222.0.45 "GET /compute/v2.1/servers/217725d8-74b1-41e3-b843-83904b818755" status: 200 len: 1267 microversion: 2.1 time: 0.188735 Aug 01 16:46:37.614719 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 465/941] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:46:37 2022] GET /compute/v2.1/servers/217725d8-74b1-41e3-b843-83904b818755 => generated 1267 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:46:38.639195 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-a763e0ba-f7a8-45e1-a2b4-cc40922f9702 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:46:38.640867 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-a763e0ba-f7a8-45e1-a2b4-cc40922f9702 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] [instance: 217725d8-74b1-41e3-b843-83904b818755] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:46:38.649683 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a763e0ba-f7a8-45e1-a2b4-cc40922f9702 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:38.650121 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a763e0ba-f7a8-45e1-a2b4-cc40922f9702 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:38.652167 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a763e0ba-f7a8-45e1-a2b4-cc40922f9702 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:38.653107 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a763e0ba-f7a8-45e1-a2b4-cc40922f9702 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:38.828285 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-a763e0ba-f7a8-45e1-a2b4-cc40922f9702 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22cfd17a6f434deca7ef77253ae3ed2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86fcc5e23854dfba97058deac8211d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:46:38.837751 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-a763e0ba-f7a8-45e1-a2b4-cc40922f9702 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] 10.222.0.45 "GET /compute/v2.1/servers/217725d8-74b1-41e3-b843-83904b818755" status: 200 len: 1455 microversion: 2.1 time: 0.204127 Aug 01 16:46:38.838373 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 477/942] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:46:38 2022] GET /compute/v2.1/servers/217725d8-74b1-41e3-b843-83904b818755 => generated 1455 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:46:38.861073 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-b7aaca3e-5349-48da-b93e-24436801b575 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:46:38.862876 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-b7aaca3e-5349-48da-b93e-24436801b575 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] [instance: 217725d8-74b1-41e3-b843-83904b818755] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:46:38.872899 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-b7aaca3e-5349-48da-b93e-24436801b575 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:38.873491 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-b7aaca3e-5349-48da-b93e-24436801b575 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:38.874725 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-b7aaca3e-5349-48da-b93e-24436801b575 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:38.875318 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-b7aaca3e-5349-48da-b93e-24436801b575 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:39.040904 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-b7aaca3e-5349-48da-b93e-24436801b575 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22cfd17a6f434deca7ef77253ae3ed2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86fcc5e23854dfba97058deac8211d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:46:39.048868 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-b7aaca3e-5349-48da-b93e-24436801b575 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] 10.222.0.45 "GET /compute/v2.1/servers/217725d8-74b1-41e3-b843-83904b818755" status: 200 len: 1455 microversion: 2.1 time: 0.193551 Aug 01 16:46:39.049406 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 466/943] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:46:38 2022] GET /compute/v2.1/servers/217725d8-74b1-41e3-b843-83904b818755 => generated 1455 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:46:41.126850 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [req-ac7eb755-c2ad-4138-b4d3-ad9416aa348b req-f0bcd758-9aa0-4453-802c-818ae75d41b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "217725d8-74b1-41e3-b843-83904b818755", "tag": "36b424b9-b58b-402c-926b-0bb6a125aa3a"}]} {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:46:41.137534 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-ac7eb755-c2ad-4138-b4d3-ad9416aa348b req-f0bcd758-9aa0-4453-802c-818ae75d41b4 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:41.137976 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-ac7eb755-c2ad-4138-b4d3-ad9416aa348b req-f0bcd758-9aa0-4453-802c-818ae75d41b4 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:41.151679 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.compute.server_external_events [req-ac7eb755-c2ad-4138-b4d3-ad9416aa348b req-f0bcd758-9aa0-4453-802c-818ae75d41b4 service nova] Creating event network-changed:36b424b9-b58b-402c-926b-0bb6a125aa3a for instance 217725d8-74b1-41e3-b843-83904b818755 on hv-cinder-85032 Aug 01 16:46:41.160570 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [req-ac7eb755-c2ad-4138-b4d3-ad9416aa348b req-f0bcd758-9aa0-4453-802c-818ae75d41b4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039374 Aug 01 16:46:41.161444 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 478/944] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:46:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:46:46.399876 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-decd6a4f-2a68-4609-95e7-13a1cf19d546 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:46:46.402030 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-decd6a4f-2a68-4609-95e7-13a1cf19d546 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:46:46.409007 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-decd6a4f-2a68-4609-95e7-13a1cf19d546 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:46.409454 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-decd6a4f-2a68-4609-95e7-13a1cf19d546 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:46.411024 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-decd6a4f-2a68-4609-95e7-13a1cf19d546 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:46.411462 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-decd6a4f-2a68-4609-95e7-13a1cf19d546 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:46.414022 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_cell1:SELECT=77,nova_cell1:INSERT=1 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:46:46.445328 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-decd6a4f-2a68-4609-95e7-13a1cf19d546 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049472 Aug 01 16:46:46.445923 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 467/945] 10.222.0.45 () {60 vars in 1343 bytes} [Mon Aug 1 16:46:46 2022] GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:46:46.516045 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-9abfb205-f1f6-40a9-8c7d-c870e9e08fc3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:46:46.517116 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-9abfb205-f1f6-40a9-8c7d-c870e9e08fc3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:46:46.524020 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-9abfb205-f1f6-40a9-8c7d-c870e9e08fc3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:46.524468 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-9abfb205-f1f6-40a9-8c7d-c870e9e08fc3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:46.525237 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-9abfb205-f1f6-40a9-8c7d-c870e9e08fc3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:46.525671 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-9abfb205-f1f6-40a9-8c7d-c870e9e08fc3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:46.551666 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-9abfb205-f1f6-40a9-8c7d-c870e9e08fc3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Going to try to terminate instance {{(pid=118118) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 16:46:46.635126 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-9abfb205-f1f6-40a9-8c7d-c870e9e08fc3 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "DELETE /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926" status: 204 len: 0 microversion: 2.20 time: 0.123554 Aug 01 16:46:46.635838 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 479/946] 10.222.0.45 () {60 vars in 1280 bytes} [Mon Aug 1 16:46:46 2022] DELETE /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 01 16:46:46.644627 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-20c04d41-79de-40e0-b053-7a76d55f8940 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:46:46.645395 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-20c04d41-79de-40e0-b053-7a76d55f8940 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:46:46.651860 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-20c04d41-79de-40e0-b053-7a76d55f8940 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:46.652304 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-20c04d41-79de-40e0-b053-7a76d55f8940 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:46.653081 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-20c04d41-79de-40e0-b053-7a76d55f8940 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:46.653500 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-20c04d41-79de-40e0-b053-7a76d55f8940 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:46.796535 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-20c04d41-79de-40e0-b053-7a76d55f8940 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:46:46.805922 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-20c04d41-79de-40e0-b053-7a76d55f8940 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:46:46.807414 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-20c04d41-79de-40e0-b053-7a76d55f8940 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:46:46.808631 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-20c04d41-79de-40e0-b053-7a76d55f8940 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926" status: 200 len: 1724 microversion: 2.20 time: 0.168219 Aug 01 16:46:46.809182 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 468/947] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:46:46 2022] GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:46:47.138809 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-a361ae3b-7b2b-4b32-980b-6f081eb55ab2 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1488194484", "imageRef": "c9cb5329-85cb-4472-935d-c4ea1d1f0592", "flavorRef": "452", "networks": [{"uuid": "269cd149-9a33-4026-8d69-7158f0e0a0f2"}]}} {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:46:47.195391 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.network.neutron [None req-a361ae3b-7b2b-4b32-980b-6f081eb55ab2 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] validate_networks() for [('269cd149-9a33-4026-8d69-7158f0e0a0f2', None, None, None, None, None)] {{(pid=118118) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 16:46:47.576548 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.virt.hardware [None req-a361ae3b-7b2b-4b32-980b-6f081eb55ab2 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Flavor limits 0:0:0 {{(pid=118118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 16:46:47.577143 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.virt.hardware [None req-a361ae3b-7b2b-4b32-980b-6f081eb55ab2 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Image limits 0:0:0 {{(pid=118118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 16:46:47.577428 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.virt.hardware [None req-a361ae3b-7b2b-4b32-980b-6f081eb55ab2 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Flavor pref 0:0:0 {{(pid=118118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 16:46:47.577801 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.virt.hardware [None req-a361ae3b-7b2b-4b32-980b-6f081eb55ab2 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Image pref 0:0:0 {{(pid=118118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 16:46:47.578203 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.virt.hardware [None req-a361ae3b-7b2b-4b32-980b-6f081eb55ab2 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 16:46:47.590357 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a361ae3b-7b2b-4b32-980b-6f081eb55ab2 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:47.590815 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a361ae3b-7b2b-4b32-980b-6f081eb55ab2 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:47.591693 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a361ae3b-7b2b-4b32-980b-6f081eb55ab2 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:47.592059 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a361ae3b-7b2b-4b32-980b-6f081eb55ab2 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:47.610892 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.quota [None req-a361ae3b-7b2b-4b32-980b-6f081eb55ab2 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Getting quotas for project 01e1704c3b1e4729820088ca9ed48368. Resources: {'cores', 'ram', 'instances'} {{(pid=118118) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 16:46:47.615414 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.quota [None req-a361ae3b-7b2b-4b32-980b-6f081eb55ab2 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Getting quotas for user 39593dbdff134fb1af13b341d6c01e37 and project 01e1704c3b1e4729820088ca9ed48368. Resources: {'cores', 'ram', 'instances'} {{(pid=118118) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 16:46:47.626595 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-a361ae3b-7b2b-4b32-980b-6f081eb55ab2 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Going to run 1 instances... {{(pid=118118) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 16:46:47.629243 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-a361ae3b-7b2b-4b32-980b-6f081eb55ab2 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] [instance: 5eb891fa-5b8f-4883-a2f9-17e6f52a5470] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c9cb5329-85cb-4472-935d-c4ea1d1f0592',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118118) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 16:46:47.675748 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-a361ae3b-7b2b-4b32-980b-6f081eb55ab2 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.543446 Aug 01 16:46:47.676789 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 480/948] 10.222.0.45 () {60 vars in 1147 bytes} [Mon Aug 1 16:46:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 546 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 16:46:47.691741 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-2abcbea6-4541-4b19-943c-9f57cf299c92 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:46:47.692676 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-2abcbea6-4541-4b19-943c-9f57cf299c92 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] [instance: 5eb891fa-5b8f-4883-a2f9-17e6f52a5470] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:46:47.757612 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-2abcbea6-4541-4b19-943c-9f57cf299c92 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39593dbdff134fb1af13b341d6c01e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e1704c3b1e4729820088ca9ed48368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:46:47.764642 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-2abcbea6-4541-4b19-943c-9f57cf299c92 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] 10.222.0.45 "GET /compute/v2.1/servers/5eb891fa-5b8f-4883-a2f9-17e6f52a5470" status: 200 len: 1219 microversion: 2.1 time: 0.076979 Aug 01 16:46:47.765219 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 469/949] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:46:47 2022] GET /compute/v2.1/servers/5eb891fa-5b8f-4883-a2f9-17e6f52a5470 => generated 1219 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:46:47.832501 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-a0134f3c-3135-45ca-91a4-b4bb77c2edfe tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:46:47.833299 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-a0134f3c-3135-45ca-91a4-b4bb77c2edfe tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:46:47.840242 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a0134f3c-3135-45ca-91a4-b4bb77c2edfe tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:47.840774 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a0134f3c-3135-45ca-91a4-b4bb77c2edfe tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:47.841755 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a0134f3c-3135-45ca-91a4-b4bb77c2edfe tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:47.842114 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a0134f3c-3135-45ca-91a4-b4bb77c2edfe tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:47.993511 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-a0134f3c-3135-45ca-91a4-b4bb77c2edfe tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:46:48.002103 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-a0134f3c-3135-45ca-91a4-b4bb77c2edfe tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:46:48.003973 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-a0134f3c-3135-45ca-91a4-b4bb77c2edfe tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:46:48.005147 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-a0134f3c-3135-45ca-91a4-b4bb77c2edfe tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926" status: 200 len: 1724 microversion: 2.20 time: 0.176884 Aug 01 16:46:48.005841 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 481/950] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:46:47 2022] GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926 => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:46:48.788053 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-d7b603ed-ca7b-4a4b-9d18-e17d84e2f1ef tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:46:48.789290 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-d7b603ed-ca7b-4a4b-9d18-e17d84e2f1ef tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] [instance: 5eb891fa-5b8f-4883-a2f9-17e6f52a5470] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:46:48.797422 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-d7b603ed-ca7b-4a4b-9d18-e17d84e2f1ef tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:48.798127 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-d7b603ed-ca7b-4a4b-9d18-e17d84e2f1ef tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:48.799110 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-d7b603ed-ca7b-4a4b-9d18-e17d84e2f1ef tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:48.799692 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-d7b603ed-ca7b-4a4b-9d18-e17d84e2f1ef tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:48.889335 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-d7b603ed-ca7b-4a4b-9d18-e17d84e2f1ef tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39593dbdff134fb1af13b341d6c01e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e1704c3b1e4729820088ca9ed48368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:46:48.903724 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-d7b603ed-ca7b-4a4b-9d18-e17d84e2f1ef tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] 10.222.0.45 "GET /compute/v2.1/servers/5eb891fa-5b8f-4883-a2f9-17e6f52a5470" status: 200 len: 1279 microversion: 2.1 time: 0.121148 Aug 01 16:46:48.904338 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 470/951] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:46:48 2022] GET /compute/v2.1/servers/5eb891fa-5b8f-4883-a2f9-17e6f52a5470 => generated 1279 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:46:49.030039 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-65e5bdc3-51e1-48b7-b286-54dd4c3be025 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:46:49.030733 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-65e5bdc3-51e1-48b7-b286-54dd4c3be025 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:46:49.038573 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-65e5bdc3-51e1-48b7-b286-54dd4c3be025 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:49.039364 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-65e5bdc3-51e1-48b7-b286-54dd4c3be025 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:49.040326 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-65e5bdc3-51e1-48b7-b286-54dd4c3be025 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:49.041098 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-65e5bdc3-51e1-48b7-b286-54dd4c3be025 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:49.122192 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-65e5bdc3-51e1-48b7-b286-54dd4c3be025 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:46:49.134871 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-65e5bdc3-51e1-48b7-b286-54dd4c3be025 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:46:49.137652 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-65e5bdc3-51e1-48b7-b286-54dd4c3be025 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76c1fab92b854cd8937cc80818159191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1c9729df694f46987e6dd30a09d5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:46:49.139629 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-65e5bdc3-51e1-48b7-b286-54dd4c3be025 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926" status: 200 len: 1657 microversion: 2.20 time: 0.113915 Aug 01 16:46:49.140889 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 482/952] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:46:49 2022] GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926 => generated 1657 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 16:46:49.172527 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [req-547103bd-8c54-4e37-afd4-948a7ce87d77 req-e954ec5f-9254-4e52-a68f-22f83fc1e39a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "144c8e15-97cd-4e0d-9d60-2ba97c26e926", "name": "network-vif-deleted", "tag": "4f59fd5b-8ef2-4634-a3a5-063fd9fa3526"}]} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:46:49.183281 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-547103bd-8c54-4e37-afd4-948a7ce87d77 req-e954ec5f-9254-4e52-a68f-22f83fc1e39a service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:49.184058 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-547103bd-8c54-4e37-afd4-948a7ce87d77 req-e954ec5f-9254-4e52-a68f-22f83fc1e39a service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:49.210252 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.compute.server_external_events [req-547103bd-8c54-4e37-afd4-948a7ce87d77 req-e954ec5f-9254-4e52-a68f-22f83fc1e39a service nova] Creating event network-vif-deleted:4f59fd5b-8ef2-4634-a3a5-063fd9fa3526 for instance 144c8e15-97cd-4e0d-9d60-2ba97c26e926 on hv-cinder-85032 Aug 01 16:46:49.217599 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [req-547103bd-8c54-4e37-afd4-948a7ce87d77 req-e954ec5f-9254-4e52-a68f-22f83fc1e39a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049949 Aug 01 16:46:49.218618 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 471/953] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:46:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:46:49.927185 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-3b355409-66a1-449b-92db-fd4a62d0634d tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:46:49.927903 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-3b355409-66a1-449b-92db-fd4a62d0634d tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] [instance: 5eb891fa-5b8f-4883-a2f9-17e6f52a5470] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:46:49.935279 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3b355409-66a1-449b-92db-fd4a62d0634d tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:49.935718 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3b355409-66a1-449b-92db-fd4a62d0634d tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:49.936773 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3b355409-66a1-449b-92db-fd4a62d0634d tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:49.937209 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3b355409-66a1-449b-92db-fd4a62d0634d tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:50.125419 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-3b355409-66a1-449b-92db-fd4a62d0634d tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39593dbdff134fb1af13b341d6c01e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e1704c3b1e4729820088ca9ed48368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:46:50.136707 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-3b355409-66a1-449b-92db-fd4a62d0634d tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] 10.222.0.45 "GET /compute/v2.1/servers/5eb891fa-5b8f-4883-a2f9-17e6f52a5470" status: 200 len: 1319 microversion: 2.1 time: 0.214065 Aug 01 16:46:50.137322 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 483/954] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:46:49 2022] GET /compute/v2.1/servers/5eb891fa-5b8f-4883-a2f9-17e6f52a5470 => generated 1319 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:46:50.165283 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-497a303a-35f7-41b6-b785-547e65ad4eb0 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:46:50.165832 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-497a303a-35f7-41b6-b785-547e65ad4eb0 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:46:50.174368 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-497a303a-35f7-41b6-b785-547e65ad4eb0 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:50.175112 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-497a303a-35f7-41b6-b785-547e65ad4eb0 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:50.176443 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-497a303a-35f7-41b6-b785-547e65ad4eb0 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:50.176868 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-497a303a-35f7-41b6-b785-547e65ad4eb0 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:50.198293 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.wsgi [None req-497a303a-35f7-41b6-b785-547e65ad4eb0 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] HTTP exception thrown: Instance 144c8e15-97cd-4e0d-9d60-2ba97c26e926 could not be found. Aug 01 16:46:50.200653 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-497a303a-35f7-41b6-b785-547e65ad4eb0 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Request method failure captured: Aug 01 16:46:50.200653 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: request: GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926 HTTP/1.1 Aug 01 16:46:50.200653 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Accept: application/json Aug 01 16:46:50.200653 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Accept-Encoding: identity Aug 01 16:46:50.200653 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Connection: close Aug 01 16:46:50.200653 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Content-Length: 0 Aug 01 16:46:50.200653 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Content-Type: application/json Aug 01 16:46:50.200653 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Host: 10.222.0.45 Aug 01 16:46:50.200653 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Openstack-System-Scope: None Aug 01 16:46:50.200653 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: User-Agent: python-urllib3/1.26.10 Aug 01 16:46:50.200653 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Auth-Token: gAAAAABi6AG_hl-bZ6rN8VgIzIgYQmKIJrpE_YJvPjFkFU5GY1KXh43jSdEOX4F-wcLiIiFE4D_YNym_uPyXkHUxQDtrtjN7Z5NzQuDnL6OkOovHTdJG0RqHpdBj_sOja0dq8ropReHPCzLVeRUou4ZAb8kaS3P9rHsZseZqnk5FsUUpCU5iqzQ Aug 01 16:46:50.200653 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Domain-Id: None Aug 01 16:46:50.200653 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Domain-Name: None Aug 01 16:46:50.200653 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Identity-Status: Confirmed Aug 01 16:46:50.200653 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Is-Admin-Project: True Aug 01 16:46:50.200653 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Openstack-Nova-Api-Version: 2.20 Aug 01 16:46:50.200653 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Domain-Id: default Aug 01 16:46:50.200653 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Domain-Name: Default Aug 01 16:46:50.200653 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Id: 4c1c9729df694f46987e6dd30a09d5d2 Aug 01 16:46:50.200653 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1626101148 Aug 01 16:46:50.200653 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Role: reader,member Aug 01 16:46:50.200653 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Roles: reader,member Aug 01 16:46:50.202336 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_4c1c9729df694f46987e6dd30a09d5d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/4c1c9729df694f46987e6dd30a09d5d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4c1c9729df694f46987e6dd30a09d5d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4c1c9729df694f46987e6dd30a09d5d2"}]}] Aug 01 16:46:50.202336 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1626101148 Aug 01 16:46:50.202336 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Tenant-Id: 4c1c9729df694f46987e6dd30a09d5d2 Aug 01 16:46:50.202336 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1626101148 Aug 01 16:46:50.202336 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User: tempest-AttachVolumeShelveTestJSON-1626101148-project Aug 01 16:46:50.202336 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Domain-Id: default Aug 01 16:46:50.202336 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Domain-Name: Default Aug 01 16:46:50.202336 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Id: 76c1fab92b854cd8937cc80818159191 Aug 01 16:46:50.202336 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1626101148-project Aug 01 16:46:50.202336 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: method: > Aug 01 16:46:50.202336 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: exception: Instance 144c8e15-97cd-4e0d-9d60-2ba97c26e926 could not be found. Aug 01 16:46:50.202336 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: action_args: {'id': '144c8e15-97cd-4e0d-9d60-2ba97c26e926'} Aug 01 16:46:50.203594 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:46:50.203594 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:46:50.203594 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 16:46:50.203594 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 16:46:50.203594 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 16:46:50.203594 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 16:46:50.203594 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 16:46:50.203594 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 16:46:50.203594 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 16:46:50.203594 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 16:46:50.203594 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 144c8e15-97cd-4e0d-9d60-2ba97c26e926 could not be found. Aug 01 16:46:50.203594 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:46:50.203594 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:46:50.203594 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:46:50.203594 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:46:50.203594 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:46:50.203594 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:46:50.203594 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:46:50.203594 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:46:50.203594 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:46:50.205410 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:46:50.205410 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 16:46:50.205410 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 16:46:50.205410 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 16:46:50.205410 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 16:46:50.205410 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 16:46:50.205410 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:46:50.205410 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 144c8e15-97cd-4e0d-9d60-2ba97c26e926 could not be found. Aug 01 16:46:50.205410 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:46:50.205410 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:46:50.205410 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:46:50.205410 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:46:50.205410 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:46:50.205410 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:46:50.205410 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:46:50.205410 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:46:50.205410 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 144c8e15-97cd-4e0d-9d60-2ba97c26e926 could not be found. Aug 01 16:46:50.205410 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:46:50.208355 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-497a303a-35f7-41b6-b785-547e65ad4eb0 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Returning 404 to user: Instance 144c8e15-97cd-4e0d-9d60-2ba97c26e926 could not be found. {{(pid=118117) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:46:50.209223 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-497a303a-35f7-41b6-b785-547e65ad4eb0 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926" status: 404 len: 111 microversion: 2.20 time: 0.050359 Aug 01 16:46:50.210373 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 472/955] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:46:50 2022] GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 01 16:46:50.220515 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-5e1c5d82-6823-4744-a000-5435974c8822 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '.version_select at 0x7efd67413c10>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:46:50.243099 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-5e1c5d82-6823-4744-a000-5435974c8822 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1285065809" status: 204 len: 0 microversion: 2.20 time: 0.027114 Aug 01 16:46:50.244410 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 484/956] 10.222.0.45 () {60 vars in 1262 bytes} [Mon Aug 1 16:46:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1285065809 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 01 16:46:50.664517 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [req-ed683f78-d79b-4edd-9497-3a94e39a984a req-006b357c-470c-4ab6-a0a8-93376a911114 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5eb891fa-5b8f-4883-a2f9-17e6f52a5470", "tag": "d6428b1b-83e9-425f-a353-327892eeabf9"}]} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:46:50.675217 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-ed683f78-d79b-4edd-9497-3a94e39a984a req-006b357c-470c-4ab6-a0a8-93376a911114 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:50.676323 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-ed683f78-d79b-4edd-9497-3a94e39a984a req-006b357c-470c-4ab6-a0a8-93376a911114 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:50.688647 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.compute.server_external_events [req-ed683f78-d79b-4edd-9497-3a94e39a984a req-006b357c-470c-4ab6-a0a8-93376a911114 service nova] Creating event network-changed:d6428b1b-83e9-425f-a353-327892eeabf9 for instance 5eb891fa-5b8f-4883-a2f9-17e6f52a5470 on hv-cinder-85032 Aug 01 16:46:50.694743 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [req-ed683f78-d79b-4edd-9497-3a94e39a984a req-006b357c-470c-4ab6-a0a8-93376a911114 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035216 Aug 01 16:46:50.695365 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 473/957] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:46:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 16:46:51.158521 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-55ca560d-353d-48e0-bb36-ab030e380f0e tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:46:51.159144 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-55ca560d-353d-48e0-bb36-ab030e380f0e tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] [instance: 5eb891fa-5b8f-4883-a2f9-17e6f52a5470] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:46:51.165835 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-55ca560d-353d-48e0-bb36-ab030e380f0e tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:51.166278 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-55ca560d-353d-48e0-bb36-ab030e380f0e tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:51.167088 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-55ca560d-353d-48e0-bb36-ab030e380f0e tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:51.167465 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-55ca560d-353d-48e0-bb36-ab030e380f0e tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:51.311097 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-55ca560d-353d-48e0-bb36-ab030e380f0e tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39593dbdff134fb1af13b341d6c01e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e1704c3b1e4729820088ca9ed48368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:46:51.319524 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-55ca560d-353d-48e0-bb36-ab030e380f0e tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] 10.222.0.45 "GET /compute/v2.1/servers/5eb891fa-5b8f-4883-a2f9-17e6f52a5470" status: 200 len: 1319 microversion: 2.1 time: 0.165282 Aug 01 16:46:51.320387 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 485/958] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:46:51 2022] GET /compute/v2.1/servers/5eb891fa-5b8f-4883-a2f9-17e6f52a5470 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:46:52.348319 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-a213f33c-7d51-4c11-b3b8-b3a1eda2aef9 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:46:52.349010 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-a213f33c-7d51-4c11-b3b8-b3a1eda2aef9 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] [instance: 5eb891fa-5b8f-4883-a2f9-17e6f52a5470] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:46:52.356972 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-a213f33c-7d51-4c11-b3b8-b3a1eda2aef9 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:52.357455 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-a213f33c-7d51-4c11-b3b8-b3a1eda2aef9 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:52.358254 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-a213f33c-7d51-4c11-b3b8-b3a1eda2aef9 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:52.358743 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-a213f33c-7d51-4c11-b3b8-b3a1eda2aef9 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:52.516393 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-a213f33c-7d51-4c11-b3b8-b3a1eda2aef9 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39593dbdff134fb1af13b341d6c01e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e1704c3b1e4729820088ca9ed48368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:46:52.526979 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-a213f33c-7d51-4c11-b3b8-b3a1eda2aef9 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] 10.222.0.45 "GET /compute/v2.1/servers/5eb891fa-5b8f-4883-a2f9-17e6f52a5470" status: 200 len: 1319 microversion: 2.1 time: 0.183792 Aug 01 16:46:52.527819 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 474/959] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:46:52 2022] GET /compute/v2.1/servers/5eb891fa-5b8f-4883-a2f9-17e6f52a5470 => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:46:52.553010 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-239b6da0-18df-4c5c-bc71-63db9c108d2d tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:46:52.554231 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-239b6da0-18df-4c5c-bc71-63db9c108d2d tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:46:52.561621 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-239b6da0-18df-4c5c-bc71-63db9c108d2d tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:52.562064 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-239b6da0-18df-4c5c-bc71-63db9c108d2d tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:52.562849 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-239b6da0-18df-4c5c-bc71-63db9c108d2d tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:52.563275 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-239b6da0-18df-4c5c-bc71-63db9c108d2d tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:52.577914 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.wsgi [None req-239b6da0-18df-4c5c-bc71-63db9c108d2d tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] HTTP exception thrown: Instance 144c8e15-97cd-4e0d-9d60-2ba97c26e926 could not be found. Aug 01 16:46:52.579649 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-239b6da0-18df-4c5c-bc71-63db9c108d2d tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Request method failure captured: Aug 01 16:46:52.579649 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: request: DELETE /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926 HTTP/1.1 Aug 01 16:46:52.579649 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Accept: application/json Aug 01 16:46:52.579649 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Accept-Encoding: identity Aug 01 16:46:52.579649 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Connection: close Aug 01 16:46:52.579649 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Content-Length: 0 Aug 01 16:46:52.579649 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Content-Type: application/json Aug 01 16:46:52.579649 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Host: 10.222.0.45 Aug 01 16:46:52.579649 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Openstack-System-Scope: None Aug 01 16:46:52.579649 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: User-Agent: python-urllib3/1.26.10 Aug 01 16:46:52.579649 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Auth-Token: gAAAAABi6AG_hl-bZ6rN8VgIzIgYQmKIJrpE_YJvPjFkFU5GY1KXh43jSdEOX4F-wcLiIiFE4D_YNym_uPyXkHUxQDtrtjN7Z5NzQuDnL6OkOovHTdJG0RqHpdBj_sOja0dq8ropReHPCzLVeRUou4ZAb8kaS3P9rHsZseZqnk5FsUUpCU5iqzQ Aug 01 16:46:52.579649 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Domain-Id: None Aug 01 16:46:52.579649 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Domain-Name: None Aug 01 16:46:52.579649 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Identity-Status: Confirmed Aug 01 16:46:52.579649 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Is-Admin-Project: True Aug 01 16:46:52.579649 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Openstack-Nova-Api-Version: 2.20 Aug 01 16:46:52.579649 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Domain-Id: default Aug 01 16:46:52.579649 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Domain-Name: Default Aug 01 16:46:52.579649 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Id: 4c1c9729df694f46987e6dd30a09d5d2 Aug 01 16:46:52.579649 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1626101148 Aug 01 16:46:52.579649 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Role: reader,member Aug 01 16:46:52.579649 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Roles: reader,member Aug 01 16:46:52.581246 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_4c1c9729df694f46987e6dd30a09d5d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/4c1c9729df694f46987e6dd30a09d5d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4c1c9729df694f46987e6dd30a09d5d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4c1c9729df694f46987e6dd30a09d5d2"}]}] Aug 01 16:46:52.581246 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1626101148 Aug 01 16:46:52.581246 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant-Id: 4c1c9729df694f46987e6dd30a09d5d2 Aug 01 16:46:52.581246 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1626101148 Aug 01 16:46:52.581246 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User: tempest-AttachVolumeShelveTestJSON-1626101148-project Aug 01 16:46:52.581246 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Domain-Id: default Aug 01 16:46:52.581246 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Domain-Name: Default Aug 01 16:46:52.581246 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Id: 76c1fab92b854cd8937cc80818159191 Aug 01 16:46:52.581246 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1626101148-project Aug 01 16:46:52.581246 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: method: > Aug 01 16:46:52.581246 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: exception: Instance 144c8e15-97cd-4e0d-9d60-2ba97c26e926 could not be found. Aug 01 16:46:52.581246 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: action_args: {'id': '144c8e15-97cd-4e0d-9d60-2ba97c26e926'} Aug 01 16:46:52.586332 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:46:52.586332 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:46:52.586332 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 16:46:52.586332 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 16:46:52.586332 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 16:46:52.586332 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 16:46:52.586332 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 16:46:52.586332 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 16:46:52.586332 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 16:46:52.586332 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 16:46:52.586332 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 144c8e15-97cd-4e0d-9d60-2ba97c26e926 could not be found. Aug 01 16:46:52.586332 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:46:52.586332 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:46:52.586332 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:46:52.586332 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:46:52.586332 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:46:52.586332 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:46:52.586332 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:46:52.586332 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:46:52.586332 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:46:52.587901 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:46:52.587901 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 16:46:52.587901 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 16:46:52.587901 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 16:46:52.587901 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 16:46:52.587901 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 16:46:52.587901 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 16:46:52.587901 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 16:46:52.587901 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:46:52.587901 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 144c8e15-97cd-4e0d-9d60-2ba97c26e926 could not be found. Aug 01 16:46:52.587901 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:46:52.587901 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:46:52.587901 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:46:52.587901 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:46:52.587901 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:46:52.587901 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:46:52.587901 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:46:52.587901 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:46:52.587901 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 144c8e15-97cd-4e0d-9d60-2ba97c26e926 could not be found. Aug 01 16:46:52.587901 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:46:52.589472 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-239b6da0-18df-4c5c-bc71-63db9c108d2d tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Returning 404 to user: Instance 144c8e15-97cd-4e0d-9d60-2ba97c26e926 could not be found. {{(pid=118118) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:46:52.589472 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-239b6da0-18df-4c5c-bc71-63db9c108d2d tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "DELETE /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926" status: 404 len: 111 microversion: 2.20 time: 0.032516 Aug 01 16:46:52.589472 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 486/960] 10.222.0.45 () {60 vars in 1280 bytes} [Mon Aug 1 16:46:52 2022] DELETE /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 01 16:46:52.590308 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-8f229501-dde2-4a68-8945-aa011d035c7a tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:46:52.590921 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-8f229501-dde2-4a68-8945-aa011d035c7a tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: 144c8e15-97cd-4e0d-9d60-2ba97c26e926] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:46:52.597268 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-8f229501-dde2-4a68-8945-aa011d035c7a tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:52.598446 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-8f229501-dde2-4a68-8945-aa011d035c7a tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:52.599231 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-8f229501-dde2-4a68-8945-aa011d035c7a tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:52.599671 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-8f229501-dde2-4a68-8945-aa011d035c7a tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:52.614695 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.wsgi [None req-8f229501-dde2-4a68-8945-aa011d035c7a tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] HTTP exception thrown: Instance 144c8e15-97cd-4e0d-9d60-2ba97c26e926 could not be found. Aug 01 16:46:52.616376 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-8f229501-dde2-4a68-8945-aa011d035c7a tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Request method failure captured: Aug 01 16:46:52.616376 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: request: GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926 HTTP/1.1 Aug 01 16:46:52.616376 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Accept: application/json Aug 01 16:46:52.616376 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Accept-Encoding: identity Aug 01 16:46:52.616376 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Connection: close Aug 01 16:46:52.616376 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Content-Length: 0 Aug 01 16:46:52.616376 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Content-Type: application/json Aug 01 16:46:52.616376 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Host: 10.222.0.45 Aug 01 16:46:52.616376 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Openstack-System-Scope: None Aug 01 16:46:52.616376 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: User-Agent: python-urllib3/1.26.10 Aug 01 16:46:52.616376 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Auth-Token: gAAAAABi6AG_hl-bZ6rN8VgIzIgYQmKIJrpE_YJvPjFkFU5GY1KXh43jSdEOX4F-wcLiIiFE4D_YNym_uPyXkHUxQDtrtjN7Z5NzQuDnL6OkOovHTdJG0RqHpdBj_sOja0dq8ropReHPCzLVeRUou4ZAb8kaS3P9rHsZseZqnk5FsUUpCU5iqzQ Aug 01 16:46:52.616376 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Domain-Id: None Aug 01 16:46:52.616376 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Domain-Name: None Aug 01 16:46:52.616376 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Identity-Status: Confirmed Aug 01 16:46:52.616376 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Is-Admin-Project: True Aug 01 16:46:52.616376 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Openstack-Nova-Api-Version: 2.20 Aug 01 16:46:52.616376 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Domain-Id: default Aug 01 16:46:52.616376 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Domain-Name: Default Aug 01 16:46:52.616376 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Id: 4c1c9729df694f46987e6dd30a09d5d2 Aug 01 16:46:52.616376 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1626101148 Aug 01 16:46:52.616376 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Role: reader,member Aug 01 16:46:52.616376 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Roles: reader,member Aug 01 16:46:52.619032 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_4c1c9729df694f46987e6dd30a09d5d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/4c1c9729df694f46987e6dd30a09d5d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4c1c9729df694f46987e6dd30a09d5d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4c1c9729df694f46987e6dd30a09d5d2"}]}] Aug 01 16:46:52.619032 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1626101148 Aug 01 16:46:52.619032 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Tenant-Id: 4c1c9729df694f46987e6dd30a09d5d2 Aug 01 16:46:52.619032 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1626101148 Aug 01 16:46:52.619032 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User: tempest-AttachVolumeShelveTestJSON-1626101148-project Aug 01 16:46:52.619032 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Domain-Id: default Aug 01 16:46:52.619032 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Domain-Name: Default Aug 01 16:46:52.619032 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Id: 76c1fab92b854cd8937cc80818159191 Aug 01 16:46:52.619032 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1626101148-project Aug 01 16:46:52.619032 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: method: > Aug 01 16:46:52.619032 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: exception: Instance 144c8e15-97cd-4e0d-9d60-2ba97c26e926 could not be found. Aug 01 16:46:52.619032 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: action_args: {'id': '144c8e15-97cd-4e0d-9d60-2ba97c26e926'} Aug 01 16:46:52.620654 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:46:52.620654 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:46:52.620654 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 16:46:52.620654 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 16:46:52.620654 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 16:46:52.620654 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 16:46:52.620654 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 16:46:52.620654 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 16:46:52.620654 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 16:46:52.620654 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 16:46:52.620654 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 144c8e15-97cd-4e0d-9d60-2ba97c26e926 could not be found. Aug 01 16:46:52.620654 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:46:52.620654 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:46:52.620654 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:46:52.620654 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:46:52.620654 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:46:52.620654 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:46:52.620654 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:46:52.620654 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:46:52.620654 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:46:52.623218 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:46:52.623218 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 16:46:52.623218 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 16:46:52.623218 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 16:46:52.623218 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 16:46:52.623218 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 16:46:52.623218 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:46:52.623218 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 144c8e15-97cd-4e0d-9d60-2ba97c26e926 could not be found. Aug 01 16:46:52.623218 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:46:52.623218 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:46:52.623218 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:46:52.623218 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:46:52.623218 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:46:52.623218 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:46:52.623218 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:46:52.623218 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:46:52.623218 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 144c8e15-97cd-4e0d-9d60-2ba97c26e926 could not be found. Aug 01 16:46:52.623218 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:46:52.626054 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-8f229501-dde2-4a68-8945-aa011d035c7a tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Returning 404 to user: Instance 144c8e15-97cd-4e0d-9d60-2ba97c26e926 could not be found. {{(pid=118117) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:46:52.626054 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-8f229501-dde2-4a68-8945-aa011d035c7a tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926" status: 404 len: 111 microversion: 2.20 time: 0.031356 Aug 01 16:46:52.626054 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 475/961] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:46:52 2022] GET /compute/v2.1/servers/144c8e15-97cd-4e0d-9d60-2ba97c26e926 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 01 16:46:53.547924 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-92357e75-fa7e-429b-b7ba-648cd81611db tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:46:53.548533 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-92357e75-fa7e-429b-b7ba-648cd81611db tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] [instance: 5eb891fa-5b8f-4883-a2f9-17e6f52a5470] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:46:53.555095 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-92357e75-fa7e-429b-b7ba-648cd81611db tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:53.555734 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-92357e75-fa7e-429b-b7ba-648cd81611db tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:53.556351 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-92357e75-fa7e-429b-b7ba-648cd81611db tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:53.556772 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-92357e75-fa7e-429b-b7ba-648cd81611db tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:53.693092 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-92357e75-fa7e-429b-b7ba-648cd81611db tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39593dbdff134fb1af13b341d6c01e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e1704c3b1e4729820088ca9ed48368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:46:53.700998 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-92357e75-fa7e-429b-b7ba-648cd81611db tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] 10.222.0.45 "GET /compute/v2.1/servers/5eb891fa-5b8f-4883-a2f9-17e6f52a5470" status: 200 len: 1319 microversion: 2.1 time: 0.156992 Aug 01 16:46:53.701511 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 487/962] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:46:53 2022] GET /compute/v2.1/servers/5eb891fa-5b8f-4883-a2f9-17e6f52a5470 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:46:53.788239 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-ec8bd59a-7847-4ee8-990b-994f664f4cc7 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:46:53.788848 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-ec8bd59a-7847-4ee8-990b-994f664f4cc7 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:46:53.795943 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-ec8bd59a-7847-4ee8-990b-994f664f4cc7 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:53.796410 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-ec8bd59a-7847-4ee8-990b-994f664f4cc7 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:53.797148 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-ec8bd59a-7847-4ee8-990b-994f664f4cc7 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:53.797572 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-ec8bd59a-7847-4ee8-990b-994f664f4cc7 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:53.812206 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.wsgi [None req-ec8bd59a-7847-4ee8-990b-994f664f4cc7 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] HTTP exception thrown: Instance f1c8ed71-ea21-4bca-91bf-febe7457300e could not be found. Aug 01 16:46:53.813780 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-ec8bd59a-7847-4ee8-990b-994f664f4cc7 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Request method failure captured: Aug 01 16:46:53.813780 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: request: DELETE /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e HTTP/1.1 Aug 01 16:46:53.813780 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Accept: application/json Aug 01 16:46:53.813780 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Accept-Encoding: identity Aug 01 16:46:53.813780 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Connection: close Aug 01 16:46:53.813780 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Content-Length: 0 Aug 01 16:46:53.813780 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Content-Type: application/json Aug 01 16:46:53.813780 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Host: 10.222.0.45 Aug 01 16:46:53.813780 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Openstack-System-Scope: None Aug 01 16:46:53.813780 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: User-Agent: python-urllib3/1.26.10 Aug 01 16:46:53.813780 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Auth-Token: gAAAAABi6AG_hl-bZ6rN8VgIzIgYQmKIJrpE_YJvPjFkFU5GY1KXh43jSdEOX4F-wcLiIiFE4D_YNym_uPyXkHUxQDtrtjN7Z5NzQuDnL6OkOovHTdJG0RqHpdBj_sOja0dq8ropReHPCzLVeRUou4ZAb8kaS3P9rHsZseZqnk5FsUUpCU5iqzQ Aug 01 16:46:53.813780 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Domain-Id: None Aug 01 16:46:53.813780 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Domain-Name: None Aug 01 16:46:53.813780 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Identity-Status: Confirmed Aug 01 16:46:53.813780 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Is-Admin-Project: True Aug 01 16:46:53.813780 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Openstack-Nova-Api-Version: 2.20 Aug 01 16:46:53.813780 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Domain-Id: default Aug 01 16:46:53.813780 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Domain-Name: Default Aug 01 16:46:53.813780 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Id: 4c1c9729df694f46987e6dd30a09d5d2 Aug 01 16:46:53.813780 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1626101148 Aug 01 16:46:53.813780 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Role: reader,member Aug 01 16:46:53.813780 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Roles: reader,member Aug 01 16:46:53.815652 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_4c1c9729df694f46987e6dd30a09d5d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/4c1c9729df694f46987e6dd30a09d5d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4c1c9729df694f46987e6dd30a09d5d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4c1c9729df694f46987e6dd30a09d5d2"}]}] Aug 01 16:46:53.815652 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1626101148 Aug 01 16:46:53.815652 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Tenant-Id: 4c1c9729df694f46987e6dd30a09d5d2 Aug 01 16:46:53.815652 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1626101148 Aug 01 16:46:53.815652 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User: tempest-AttachVolumeShelveTestJSON-1626101148-project Aug 01 16:46:53.815652 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Domain-Id: default Aug 01 16:46:53.815652 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Domain-Name: Default Aug 01 16:46:53.815652 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Id: 76c1fab92b854cd8937cc80818159191 Aug 01 16:46:53.815652 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1626101148-project Aug 01 16:46:53.815652 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: method: > Aug 01 16:46:53.815652 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: exception: Instance f1c8ed71-ea21-4bca-91bf-febe7457300e could not be found. Aug 01 16:46:53.815652 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: action_args: {'id': 'f1c8ed71-ea21-4bca-91bf-febe7457300e'} Aug 01 16:46:53.817070 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:46:53.817070 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:46:53.817070 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 16:46:53.817070 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 16:46:53.817070 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 16:46:53.817070 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 16:46:53.817070 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 16:46:53.817070 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 16:46:53.817070 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 16:46:53.817070 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 16:46:53.817070 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1c8ed71-ea21-4bca-91bf-febe7457300e could not be found. Aug 01 16:46:53.817070 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:46:53.817070 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:46:53.817070 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:46:53.817070 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:46:53.817070 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:46:53.817070 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:46:53.817070 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:46:53.817070 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:46:53.817070 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:46:53.818454 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:46:53.818454 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 16:46:53.818454 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 16:46:53.818454 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 16:46:53.818454 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 16:46:53.818454 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 16:46:53.818454 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 16:46:53.818454 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 16:46:53.818454 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:46:53.818454 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1c8ed71-ea21-4bca-91bf-febe7457300e could not be found. Aug 01 16:46:53.818454 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:46:53.818454 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:46:53.818454 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:46:53.818454 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:46:53.818454 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:46:53.818454 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:46:53.818454 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:46:53.818454 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:46:53.818454 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1c8ed71-ea21-4bca-91bf-febe7457300e could not be found. Aug 01 16:46:53.818454 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:46:53.819833 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-ec8bd59a-7847-4ee8-990b-994f664f4cc7 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Returning 404 to user: Instance f1c8ed71-ea21-4bca-91bf-febe7457300e could not be found. {{(pid=118117) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:46:53.819833 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-ec8bd59a-7847-4ee8-990b-994f664f4cc7 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "DELETE /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 404 len: 111 microversion: 2.20 time: 0.031852 Aug 01 16:46:53.819833 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 476/963] 10.222.0.45 () {60 vars in 1280 bytes} [Mon Aug 1 16:46:53 2022] DELETE /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 01 16:46:53.824668 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-c215b456-8bb9-4c13-9f68-61516b039e05 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:46:53.825278 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-c215b456-8bb9-4c13-9f68-61516b039e05 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] [instance: f1c8ed71-ea21-4bca-91bf-febe7457300e] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:46:53.831540 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-c215b456-8bb9-4c13-9f68-61516b039e05 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:53.832019 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-c215b456-8bb9-4c13-9f68-61516b039e05 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:53.832807 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-c215b456-8bb9-4c13-9f68-61516b039e05 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:53.833232 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-c215b456-8bb9-4c13-9f68-61516b039e05 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:53.847481 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.wsgi [None req-c215b456-8bb9-4c13-9f68-61516b039e05 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] HTTP exception thrown: Instance f1c8ed71-ea21-4bca-91bf-febe7457300e could not be found. Aug 01 16:46:53.849225 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-c215b456-8bb9-4c13-9f68-61516b039e05 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Request method failure captured: Aug 01 16:46:53.849225 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: request: GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e HTTP/1.1 Aug 01 16:46:53.849225 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Accept: application/json Aug 01 16:46:53.849225 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Accept-Encoding: identity Aug 01 16:46:53.849225 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Connection: close Aug 01 16:46:53.849225 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Content-Length: 0 Aug 01 16:46:53.849225 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Content-Type: application/json Aug 01 16:46:53.849225 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Host: 10.222.0.45 Aug 01 16:46:53.849225 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Openstack-System-Scope: None Aug 01 16:46:53.849225 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: User-Agent: python-urllib3/1.26.10 Aug 01 16:46:53.849225 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Auth-Token: gAAAAABi6AG_hl-bZ6rN8VgIzIgYQmKIJrpE_YJvPjFkFU5GY1KXh43jSdEOX4F-wcLiIiFE4D_YNym_uPyXkHUxQDtrtjN7Z5NzQuDnL6OkOovHTdJG0RqHpdBj_sOja0dq8ropReHPCzLVeRUou4ZAb8kaS3P9rHsZseZqnk5FsUUpCU5iqzQ Aug 01 16:46:53.849225 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Domain-Id: None Aug 01 16:46:53.849225 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Domain-Name: None Aug 01 16:46:53.849225 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Identity-Status: Confirmed Aug 01 16:46:53.849225 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Is-Admin-Project: True Aug 01 16:46:53.849225 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Openstack-Nova-Api-Version: 2.20 Aug 01 16:46:53.849225 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Domain-Id: default Aug 01 16:46:53.849225 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Domain-Name: Default Aug 01 16:46:53.849225 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Id: 4c1c9729df694f46987e6dd30a09d5d2 Aug 01 16:46:53.849225 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1626101148 Aug 01 16:46:53.849225 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Role: reader,member Aug 01 16:46:53.849225 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Roles: reader,member Aug 01 16:46:53.850872 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_4c1c9729df694f46987e6dd30a09d5d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/4c1c9729df694f46987e6dd30a09d5d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4c1c9729df694f46987e6dd30a09d5d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/4c1c9729df694f46987e6dd30a09d5d2"}]}] Aug 01 16:46:53.850872 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1626101148 Aug 01 16:46:53.850872 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant-Id: 4c1c9729df694f46987e6dd30a09d5d2 Aug 01 16:46:53.850872 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1626101148 Aug 01 16:46:53.850872 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User: tempest-AttachVolumeShelveTestJSON-1626101148-project Aug 01 16:46:53.850872 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Domain-Id: default Aug 01 16:46:53.850872 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Domain-Name: Default Aug 01 16:46:53.850872 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Id: 76c1fab92b854cd8937cc80818159191 Aug 01 16:46:53.850872 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1626101148-project Aug 01 16:46:53.850872 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: method: > Aug 01 16:46:53.850872 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: exception: Instance f1c8ed71-ea21-4bca-91bf-febe7457300e could not be found. Aug 01 16:46:53.850872 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: action_args: {'id': 'f1c8ed71-ea21-4bca-91bf-febe7457300e'} Aug 01 16:46:53.852030 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:46:53.852030 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:46:53.852030 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 16:46:53.852030 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 16:46:53.852030 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 16:46:53.852030 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 16:46:53.852030 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 16:46:53.852030 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 16:46:53.852030 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 16:46:53.852030 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 16:46:53.852030 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1c8ed71-ea21-4bca-91bf-febe7457300e could not be found. Aug 01 16:46:53.852030 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:46:53.852030 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:46:53.852030 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:46:53.852030 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:46:53.852030 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:46:53.852030 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:46:53.852030 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:46:53.852030 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:46:53.852030 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:46:53.853742 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:46:53.853742 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 16:46:53.853742 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 16:46:53.853742 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 16:46:53.853742 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 16:46:53.853742 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 16:46:53.853742 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:46:53.853742 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1c8ed71-ea21-4bca-91bf-febe7457300e could not be found. Aug 01 16:46:53.853742 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:46:53.853742 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:46:53.853742 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:46:53.853742 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:46:53.853742 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:46:53.853742 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:46:53.853742 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:46:53.853742 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:46:53.853742 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1c8ed71-ea21-4bca-91bf-febe7457300e could not be found. Aug 01 16:46:53.853742 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:46:53.855472 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-c215b456-8bb9-4c13-9f68-61516b039e05 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] Returning 404 to user: Instance f1c8ed71-ea21-4bca-91bf-febe7457300e could not be found. {{(pid=118118) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:46:53.855472 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-c215b456-8bb9-4c13-9f68-61516b039e05 tempest-AttachVolumeShelveTestJSON-1626101148 tempest-AttachVolumeShelveTestJSON-1626101148-project] 10.222.0.45 "GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e" status: 404 len: 111 microversion: 2.20 time: 0.029964 Aug 01 16:46:53.855472 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 488/964] 10.222.0.45 () {60 vars in 1277 bytes} [Mon Aug 1 16:46:53 2022] GET /compute/v2.1/servers/f1c8ed71-ea21-4bca-91bf-febe7457300e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 01 16:46:54.723351 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-0d9e5df6-72e1-4c4a-a788-f3d2e5776b07 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:46:54.724128 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-0d9e5df6-72e1-4c4a-a788-f3d2e5776b07 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] [instance: 5eb891fa-5b8f-4883-a2f9-17e6f52a5470] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:46:54.731178 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-0d9e5df6-72e1-4c4a-a788-f3d2e5776b07 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:54.731717 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-0d9e5df6-72e1-4c4a-a788-f3d2e5776b07 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:54.732543 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-0d9e5df6-72e1-4c4a-a788-f3d2e5776b07 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:54.732972 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-0d9e5df6-72e1-4c4a-a788-f3d2e5776b07 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:54.941504 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-0d9e5df6-72e1-4c4a-a788-f3d2e5776b07 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39593dbdff134fb1af13b341d6c01e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e1704c3b1e4729820088ca9ed48368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:46:54.949802 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-0d9e5df6-72e1-4c4a-a788-f3d2e5776b07 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] 10.222.0.45 "GET /compute/v2.1/servers/5eb891fa-5b8f-4883-a2f9-17e6f52a5470" status: 200 len: 1319 microversion: 2.1 time: 0.230752 Aug 01 16:46:54.950390 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 477/965] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:46:54 2022] GET /compute/v2.1/servers/5eb891fa-5b8f-4883-a2f9-17e6f52a5470 => generated 1319 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:46:55.973234 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-080f3d65-8396-4a81-8b46-20235721bff6 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:46:55.974746 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-080f3d65-8396-4a81-8b46-20235721bff6 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] [instance: 5eb891fa-5b8f-4883-a2f9-17e6f52a5470] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:46:55.982682 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-080f3d65-8396-4a81-8b46-20235721bff6 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:55.983521 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-080f3d65-8396-4a81-8b46-20235721bff6 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:55.984438 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-080f3d65-8396-4a81-8b46-20235721bff6 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:55.984872 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-080f3d65-8396-4a81-8b46-20235721bff6 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:56.141604 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-080f3d65-8396-4a81-8b46-20235721bff6 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39593dbdff134fb1af13b341d6c01e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e1704c3b1e4729820088ca9ed48368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:46:56.150593 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-080f3d65-8396-4a81-8b46-20235721bff6 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] 10.222.0.45 "GET /compute/v2.1/servers/5eb891fa-5b8f-4883-a2f9-17e6f52a5470" status: 200 len: 1319 microversion: 2.1 time: 0.182192 Aug 01 16:46:56.151334 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 489/966] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:46:55 2022] GET /compute/v2.1/servers/5eb891fa-5b8f-4883-a2f9-17e6f52a5470 => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:46:56.382528 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [req-30692fa0-4297-4605-957c-024f25d4a061 req-bbd5aaae-6cec-4927-b454-2e23fbbced3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5eb891fa-5b8f-4883-a2f9-17e6f52a5470", "name": "network-vif-plugged", "status": "completed", "tag": "d6428b1b-83e9-425f-a353-327892eeabf9"}]} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:46:56.394503 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-30692fa0-4297-4605-957c-024f25d4a061 req-bbd5aaae-6cec-4927-b454-2e23fbbced3d service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:56.395305 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-30692fa0-4297-4605-957c-024f25d4a061 req-bbd5aaae-6cec-4927-b454-2e23fbbced3d service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:56.407610 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.compute.server_external_events [req-30692fa0-4297-4605-957c-024f25d4a061 req-bbd5aaae-6cec-4927-b454-2e23fbbced3d service nova] Creating event network-vif-plugged:d6428b1b-83e9-425f-a353-327892eeabf9 for instance 5eb891fa-5b8f-4883-a2f9-17e6f52a5470 on hv-cinder-85032 Aug 01 16:46:56.414793 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [req-30692fa0-4297-4605-957c-024f25d4a061 req-bbd5aaae-6cec-4927-b454-2e23fbbced3d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035938 Aug 01 16:46:56.416065 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 478/967] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:46:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:46:57.172825 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-dade5f5d-2cf0-4646-a0d8-0d3fcd4627b2 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:46:57.173388 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-dade5f5d-2cf0-4646-a0d8-0d3fcd4627b2 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] [instance: 5eb891fa-5b8f-4883-a2f9-17e6f52a5470] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:46:57.180384 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-dade5f5d-2cf0-4646-a0d8-0d3fcd4627b2 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:57.180818 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-dade5f5d-2cf0-4646-a0d8-0d3fcd4627b2 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:57.181591 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-dade5f5d-2cf0-4646-a0d8-0d3fcd4627b2 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:57.182014 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-dade5f5d-2cf0-4646-a0d8-0d3fcd4627b2 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:57.186313 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:46:57.355420 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-dade5f5d-2cf0-4646-a0d8-0d3fcd4627b2 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39593dbdff134fb1af13b341d6c01e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e1704c3b1e4729820088ca9ed48368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:46:57.364355 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-dade5f5d-2cf0-4646-a0d8-0d3fcd4627b2 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] 10.222.0.45 "GET /compute/v2.1/servers/5eb891fa-5b8f-4883-a2f9-17e6f52a5470" status: 200 len: 1319 microversion: 2.1 time: 0.195214 Aug 01 16:46:57.364950 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 490/968] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:46:57 2022] GET /compute/v2.1/servers/5eb891fa-5b8f-4883-a2f9-17e6f52a5470 => generated 1319 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:46:58.383182 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_cell0:SELECT=2 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:46:58.387886 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-ed5acb3a-ee92-4b06-b2f2-ecd9ea3cd0be tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:46:58.388577 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-ed5acb3a-ee92-4b06-b2f2-ecd9ea3cd0be tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] [instance: 5eb891fa-5b8f-4883-a2f9-17e6f52a5470] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:46:58.396356 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-ed5acb3a-ee92-4b06-b2f2-ecd9ea3cd0be tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:58.396804 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-ed5acb3a-ee92-4b06-b2f2-ecd9ea3cd0be tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:58.397696 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-ed5acb3a-ee92-4b06-b2f2-ecd9ea3cd0be tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:46:58.398311 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-ed5acb3a-ee92-4b06-b2f2-ecd9ea3cd0be tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:46:58.547039 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-ed5acb3a-ee92-4b06-b2f2-ecd9ea3cd0be tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39593dbdff134fb1af13b341d6c01e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e1704c3b1e4729820088ca9ed48368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:46:58.554848 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-ed5acb3a-ee92-4b06-b2f2-ecd9ea3cd0be tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] 10.222.0.45 "GET /compute/v2.1/servers/5eb891fa-5b8f-4883-a2f9-17e6f52a5470" status: 200 len: 1507 microversion: 2.1 time: 0.173143 Aug 01 16:46:58.555426 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 479/969] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:46:58 2022] GET /compute/v2.1/servers/5eb891fa-5b8f-4883-a2f9-17e6f52a5470 => generated 1507 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:47:18.126950 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-0b126098-56c0-4ba1-bdc4-fb569332c7b4 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3a12d2e0-59c9-44b0-880d-2a81203e2fc9", "device": "/dev/sdb"}} {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:47:18.130076 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-0b126098-56c0-4ba1-bdc4-fb569332c7b4 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] [instance: 5eb891fa-5b8f-4883-a2f9-17e6f52a5470] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:47:18.132161 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_cell0:SELECT=2 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:47:18.132936 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_cell0:SELECT=6 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:47:18.133649 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:47:18.134175 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_cell1:SELECT=5 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:47:18.140854 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-0b126098-56c0-4ba1-bdc4-fb569332c7b4 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:47:18.141288 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-0b126098-56c0-4ba1-bdc4-fb569332c7b4 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:47:18.142049 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-0b126098-56c0-4ba1-bdc4-fb569332c7b4 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:47:18.142494 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-0b126098-56c0-4ba1-bdc4-fb569332c7b4 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:47:18.405835 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-0b126098-56c0-4ba1-bdc4-fb569332c7b4 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] 10.222.0.45 "POST /compute/v2.1/servers/5eb891fa-5b8f-4883-a2f9-17e6f52a5470/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.282726 Aug 01 16:47:18.406505 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 491/970] 10.222.0.45 () {60 vars in 1323 bytes} [Mon Aug 1 16:47:18 2022] POST /compute/v2.1/servers/5eb891fa-5b8f-4883-a2f9-17e6f52a5470/os-volume_attachments => generated 194 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:47:41.377574 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-fff4dbc1-3514-43af-92e8-f5dfdeb53002 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:47:41.378160 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-fff4dbc1-3514-43af-92e8-f5dfdeb53002 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] [instance: 5eb891fa-5b8f-4883-a2f9-17e6f52a5470] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:47:41.380882 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_api:SELECT=31 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:47:41.381426 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_cell1:SELECT=47 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:47:41.387070 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-fff4dbc1-3514-43af-92e8-f5dfdeb53002 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:47:41.387511 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-fff4dbc1-3514-43af-92e8-f5dfdeb53002 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:47:41.388302 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-fff4dbc1-3514-43af-92e8-f5dfdeb53002 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:47:41.388721 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-fff4dbc1-3514-43af-92e8-f5dfdeb53002 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:47:41.482746 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.objects.instance [None req-fff4dbc1-3514-43af-92e8-f5dfdeb53002 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lazy-loading 'services' on Instance uuid 5eb891fa-5b8f-4883-a2f9-17e6f52a5470 {{(pid=118117) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 16:47:41.570584 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-fff4dbc1-3514-43af-92e8-f5dfdeb53002 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] 10.222.0.45 "DELETE /compute/v2.1/servers/5eb891fa-5b8f-4883-a2f9-17e6f52a5470/os-volume_attachments/3a12d2e0-59c9-44b0-880d-2a81203e2fc9" status: 202 len: 0 microversion: 2.1 time: 0.196882 Aug 01 16:47:41.571239 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 480/971] 10.222.0.45 () {58 vars in 1416 bytes} [Mon Aug 1 16:47:41 2022] DELETE /compute/v2.1/servers/5eb891fa-5b8f-4883-a2f9-17e6f52a5470/os-volume_attachments/3a12d2e0-59c9-44b0-880d-2a81203e2fc9 => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 16:47:42.710421 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_api:SELECT=2 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:47:42.711132 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:47:42.715516 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-9119badf-3137-4a63-99ff-26cf18541d2f tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:47:42.716145 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-9119badf-3137-4a63-99ff-26cf18541d2f tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] [instance: 5eb891fa-5b8f-4883-a2f9-17e6f52a5470] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:47:42.724128 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-9119badf-3137-4a63-99ff-26cf18541d2f tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:47:42.724580 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-9119badf-3137-4a63-99ff-26cf18541d2f tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:47:42.725391 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-9119badf-3137-4a63-99ff-26cf18541d2f tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:47:42.725890 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-9119badf-3137-4a63-99ff-26cf18541d2f tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:47:42.752846 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-9119badf-3137-4a63-99ff-26cf18541d2f tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] [instance: 5eb891fa-5b8f-4883-a2f9-17e6f52a5470] Going to try to terminate instance {{(pid=118118) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 16:47:42.840683 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-9119badf-3137-4a63-99ff-26cf18541d2f tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] 10.222.0.45 "DELETE /compute/v2.1/servers/5eb891fa-5b8f-4883-a2f9-17e6f52a5470" status: 204 len: 0 microversion: 2.1 time: 0.131807 Aug 01 16:47:42.841201 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 492/972] 10.222.0.45 () {58 vars in 1239 bytes} [Mon Aug 1 16:47:42 2022] DELETE /compute/v2.1/servers/5eb891fa-5b8f-4883-a2f9-17e6f52a5470 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 16:47:42.852325 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-a1a16b27-78b3-4da1-b0b9-5ea0f286f0bb tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:47:42.853036 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-a1a16b27-78b3-4da1-b0b9-5ea0f286f0bb tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] [instance: 5eb891fa-5b8f-4883-a2f9-17e6f52a5470] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:47:42.860476 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-a1a16b27-78b3-4da1-b0b9-5ea0f286f0bb tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:47:42.860934 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-a1a16b27-78b3-4da1-b0b9-5ea0f286f0bb tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:47:42.861706 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-a1a16b27-78b3-4da1-b0b9-5ea0f286f0bb tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:47:42.862127 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-a1a16b27-78b3-4da1-b0b9-5ea0f286f0bb tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:47:43.009609 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-a1a16b27-78b3-4da1-b0b9-5ea0f286f0bb tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39593dbdff134fb1af13b341d6c01e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e1704c3b1e4729820088ca9ed48368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:47:43.017889 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-a1a16b27-78b3-4da1-b0b9-5ea0f286f0bb tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] 10.222.0.45 "GET /compute/v2.1/servers/5eb891fa-5b8f-4883-a2f9-17e6f52a5470" status: 200 len: 1513 microversion: 2.1 time: 0.171205 Aug 01 16:47:43.018417 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 481/973] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:47:42 2022] GET /compute/v2.1/servers/5eb891fa-5b8f-4883-a2f9-17e6f52a5470 => generated 1513 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:47:44.044968 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-7759ee29-6abf-41e6-8380-94572fd22365 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:47:44.045697 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-7759ee29-6abf-41e6-8380-94572fd22365 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] [instance: 5eb891fa-5b8f-4883-a2f9-17e6f52a5470] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:47:44.053028 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-7759ee29-6abf-41e6-8380-94572fd22365 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:47:44.054072 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-7759ee29-6abf-41e6-8380-94572fd22365 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:47:44.054909 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-7759ee29-6abf-41e6-8380-94572fd22365 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:47:44.055361 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-7759ee29-6abf-41e6-8380-94572fd22365 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:47:44.217488 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-7759ee29-6abf-41e6-8380-94572fd22365 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39593dbdff134fb1af13b341d6c01e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e1704c3b1e4729820088ca9ed48368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:47:44.225638 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-7759ee29-6abf-41e6-8380-94572fd22365 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] 10.222.0.45 "GET /compute/v2.1/servers/5eb891fa-5b8f-4883-a2f9-17e6f52a5470" status: 200 len: 1513 microversion: 2.1 time: 0.189881 Aug 01 16:47:44.226219 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 493/974] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:47:44 2022] GET /compute/v2.1/servers/5eb891fa-5b8f-4883-a2f9-17e6f52a5470 => generated 1513 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:47:45.046892 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [req-b5e2ab17-dd22-4f92-b241-40b8687eb44c req-8b069bd3-112b-41e2-a844-74dbfe5cf32a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5eb891fa-5b8f-4883-a2f9-17e6f52a5470", "name": "network-vif-deleted", "tag": "d6428b1b-83e9-425f-a353-327892eeabf9"}]} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:47:45.057557 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-b5e2ab17-dd22-4f92-b241-40b8687eb44c req-8b069bd3-112b-41e2-a844-74dbfe5cf32a service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:47:45.058078 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-b5e2ab17-dd22-4f92-b241-40b8687eb44c req-8b069bd3-112b-41e2-a844-74dbfe5cf32a service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:47:45.074250 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.compute.server_external_events [req-b5e2ab17-dd22-4f92-b241-40b8687eb44c req-8b069bd3-112b-41e2-a844-74dbfe5cf32a service nova] Creating event network-vif-deleted:d6428b1b-83e9-425f-a353-327892eeabf9 for instance 5eb891fa-5b8f-4883-a2f9-17e6f52a5470 on hv-cinder-85032 Aug 01 16:47:45.079608 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [req-b5e2ab17-dd22-4f92-b241-40b8687eb44c req-8b069bd3-112b-41e2-a844-74dbfe5cf32a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036267 Aug 01 16:47:45.080433 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 482/975] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:47:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 16:47:45.247537 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-1633500a-dc5d-40dd-980e-5339e1fc3abb tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:47:45.248226 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-1633500a-dc5d-40dd-980e-5339e1fc3abb tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] [instance: 5eb891fa-5b8f-4883-a2f9-17e6f52a5470] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:47:45.255022 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-1633500a-dc5d-40dd-980e-5339e1fc3abb tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:47:45.255492 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-1633500a-dc5d-40dd-980e-5339e1fc3abb tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:47:45.256300 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-1633500a-dc5d-40dd-980e-5339e1fc3abb tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:47:45.256804 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-1633500a-dc5d-40dd-980e-5339e1fc3abb tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:47:45.291047 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-1633500a-dc5d-40dd-980e-5339e1fc3abb tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:47:45.291462 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-1633500a-dc5d-40dd-980e-5339e1fc3abb tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:47:45.291969 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.objects.instance [None req-1633500a-dc5d-40dd-980e-5339e1fc3abb tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lazy-loading 'fault' on Instance uuid 5eb891fa-5b8f-4883-a2f9-17e6f52a5470 {{(pid=118118) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 16:47:45.335354 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-1633500a-dc5d-40dd-980e-5339e1fc3abb tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39593dbdff134fb1af13b341d6c01e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e1704c3b1e4729820088ca9ed48368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:47:45.343807 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-1633500a-dc5d-40dd-980e-5339e1fc3abb tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] 10.222.0.45 "GET /compute/v2.1/servers/5eb891fa-5b8f-4883-a2f9-17e6f52a5470" status: 200 len: 1309 microversion: 2.1 time: 0.100675 Aug 01 16:47:45.344207 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 494/976] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:47:45 2022] GET /compute/v2.1/servers/5eb891fa-5b8f-4883-a2f9-17e6f52a5470 => generated 1309 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:47:46.367242 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-54064561-c195-40f4-98fd-ed3f59c0e3e9 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:47:46.367859 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-54064561-c195-40f4-98fd-ed3f59c0e3e9 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] [instance: 5eb891fa-5b8f-4883-a2f9-17e6f52a5470] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:47:46.375472 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-54064561-c195-40f4-98fd-ed3f59c0e3e9 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:47:46.376290 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-54064561-c195-40f4-98fd-ed3f59c0e3e9 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:47:46.377706 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-54064561-c195-40f4-98fd-ed3f59c0e3e9 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:47:46.378288 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-54064561-c195-40f4-98fd-ed3f59c0e3e9 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:47:46.393854 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.wsgi [None req-54064561-c195-40f4-98fd-ed3f59c0e3e9 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] HTTP exception thrown: Instance 5eb891fa-5b8f-4883-a2f9-17e6f52a5470 could not be found. Aug 01 16:47:46.395702 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-54064561-c195-40f4-98fd-ed3f59c0e3e9 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Request method failure captured: Aug 01 16:47:46.395702 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: request: GET /compute/v2.1/servers/5eb891fa-5b8f-4883-a2f9-17e6f52a5470 HTTP/1.1 Aug 01 16:47:46.395702 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Accept: application/json Aug 01 16:47:46.395702 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Accept-Encoding: identity Aug 01 16:47:46.395702 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Connection: close Aug 01 16:47:46.395702 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Content-Length: 0 Aug 01 16:47:46.395702 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Content-Type: application/json Aug 01 16:47:46.395702 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Host: 10.222.0.45 Aug 01 16:47:46.395702 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Openstack-System-Scope: None Aug 01 16:47:46.395702 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: User-Agent: python-urllib3/1.26.10 Aug 01 16:47:46.395702 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Auth-Token: gAAAAABi6AN1MsmnEFLRCT-Zc5TwOcqMKKm8N_uLmPMXRTTHZ1-Mz6sfEig6834kuSDnmW2grrMUhwhSraPLz5uneVh5je_C3LJxOrP6IhgZhI8bL0Sh-iUAPBmPPpEWj7qmOD1jxOZc1i2vdsAfnx7da5pORW8XDbpJN_PArahVfeBmEplXGvc Aug 01 16:47:46.395702 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Domain-Id: None Aug 01 16:47:46.395702 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Domain-Name: None Aug 01 16:47:46.395702 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Identity-Status: Confirmed Aug 01 16:47:46.395702 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Is-Admin-Project: True Aug 01 16:47:46.395702 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Domain-Id: default Aug 01 16:47:46.395702 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Domain-Name: Default Aug 01 16:47:46.395702 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Id: 01e1704c3b1e4729820088ca9ed48368 Aug 01 16:47:46.395702 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1063588417 Aug 01 16:47:46.395702 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Role: reader,member Aug 01 16:47:46.395702 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Roles: reader,member Aug 01 16:47:46.398618 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_01e1704c3b1e4729820088ca9ed48368"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/01e1704c3b1e4729820088ca9ed48368"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/01e1704c3b1e4729820088ca9ed48368"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/01e1704c3b1e4729820088ca9ed48368"}]}] Aug 01 16:47:46.398618 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Tenant: tempest-VolumesSnapshotTestJSON-1063588417 Aug 01 16:47:46.398618 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Tenant-Id: 01e1704c3b1e4729820088ca9ed48368 Aug 01 16:47:46.398618 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1063588417 Aug 01 16:47:46.398618 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User: tempest-VolumesSnapshotTestJSON-1063588417-project Aug 01 16:47:46.398618 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Domain-Id: default Aug 01 16:47:46.398618 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Domain-Name: Default Aug 01 16:47:46.398618 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Id: 39593dbdff134fb1af13b341d6c01e37 Aug 01 16:47:46.398618 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Name: tempest-VolumesSnapshotTestJSON-1063588417-project Aug 01 16:47:46.398618 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: method: > Aug 01 16:47:46.398618 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: exception: Instance 5eb891fa-5b8f-4883-a2f9-17e6f52a5470 could not be found. Aug 01 16:47:46.398618 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: action_args: {'id': '5eb891fa-5b8f-4883-a2f9-17e6f52a5470'} Aug 01 16:47:46.399721 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:47:46.399721 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:47:46.399721 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 16:47:46.399721 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 16:47:46.399721 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 16:47:46.399721 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 16:47:46.399721 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 16:47:46.399721 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 16:47:46.399721 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 16:47:46.399721 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 16:47:46.399721 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5eb891fa-5b8f-4883-a2f9-17e6f52a5470 could not be found. Aug 01 16:47:46.399721 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:47:46.399721 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:47:46.399721 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:47:46.399721 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:47:46.399721 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:47:46.399721 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:47:46.399721 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:47:46.399721 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:47:46.399721 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:47:46.401491 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:47:46.401491 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 16:47:46.401491 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 16:47:46.401491 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 16:47:46.401491 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 16:47:46.401491 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 16:47:46.401491 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:47:46.401491 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5eb891fa-5b8f-4883-a2f9-17e6f52a5470 could not be found. Aug 01 16:47:46.401491 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:47:46.401491 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:47:46.401491 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:47:46.401491 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:47:46.401491 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:47:46.401491 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:47:46.401491 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:47:46.401491 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:47:46.401491 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5eb891fa-5b8f-4883-a2f9-17e6f52a5470 could not be found. Aug 01 16:47:46.401491 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:47:46.402701 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-54064561-c195-40f4-98fd-ed3f59c0e3e9 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Returning 404 to user: Instance 5eb891fa-5b8f-4883-a2f9-17e6f52a5470 could not be found. {{(pid=118117) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:47:46.402701 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-54064561-c195-40f4-98fd-ed3f59c0e3e9 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] 10.222.0.45 "GET /compute/v2.1/servers/5eb891fa-5b8f-4883-a2f9-17e6f52a5470" status: 404 len: 111 microversion: 2.1 time: 0.035476 Aug 01 16:47:46.402701 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 483/977] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:47:46 2022] GET /compute/v2.1/servers/5eb891fa-5b8f-4883-a2f9-17e6f52a5470 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 16:47:56.419672 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-4312c491-f955-4137-b888-4e11fcba8a11 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-974604598", "imageRef": "c9cb5329-85cb-4472-935d-c4ea1d1f0592", "flavorRef": "452", "networks": [{"uuid": "269cd149-9a33-4026-8d69-7158f0e0a0f2"}]}} {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:47:56.428856 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:47:56.429915 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:47:56.485428 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.network.neutron [None req-4312c491-f955-4137-b888-4e11fcba8a11 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] validate_networks() for [('269cd149-9a33-4026-8d69-7158f0e0a0f2', None, None, None, None, None)] {{(pid=118118) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 16:47:56.872819 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.virt.hardware [None req-4312c491-f955-4137-b888-4e11fcba8a11 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Flavor limits 0:0:0 {{(pid=118118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 16:47:56.873256 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.virt.hardware [None req-4312c491-f955-4137-b888-4e11fcba8a11 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Image limits 0:0:0 {{(pid=118118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 16:47:56.873752 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.virt.hardware [None req-4312c491-f955-4137-b888-4e11fcba8a11 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Flavor pref 0:0:0 {{(pid=118118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 16:47:56.874200 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.virt.hardware [None req-4312c491-f955-4137-b888-4e11fcba8a11 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Image pref 0:0:0 {{(pid=118118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 16:47:56.874585 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.virt.hardware [None req-4312c491-f955-4137-b888-4e11fcba8a11 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118118) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 16:47:56.885086 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-4312c491-f955-4137-b888-4e11fcba8a11 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:47:56.885816 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-4312c491-f955-4137-b888-4e11fcba8a11 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:47:56.886605 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-4312c491-f955-4137-b888-4e11fcba8a11 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:47:56.887002 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-4312c491-f955-4137-b888-4e11fcba8a11 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:47:56.905024 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.quota [None req-4312c491-f955-4137-b888-4e11fcba8a11 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Getting quotas for project 01e1704c3b1e4729820088ca9ed48368. Resources: {'cores', 'ram', 'instances'} {{(pid=118118) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 16:47:56.909428 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.quota [None req-4312c491-f955-4137-b888-4e11fcba8a11 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Getting quotas for user 39593dbdff134fb1af13b341d6c01e37 and project 01e1704c3b1e4729820088ca9ed48368. Resources: {'cores', 'ram', 'instances'} {{(pid=118118) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 16:47:56.922437 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-4312c491-f955-4137-b888-4e11fcba8a11 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Going to run 1 instances... {{(pid=118118) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 16:47:56.925950 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-4312c491-f955-4137-b888-4e11fcba8a11 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] [instance: 26f3415b-3b12-4387-9477-6a900ee63f09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c9cb5329-85cb-4472-935d-c4ea1d1f0592',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118118) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 16:47:56.985762 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-4312c491-f955-4137-b888-4e11fcba8a11 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.570079 Aug 01 16:47:56.986635 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 495/978] 10.222.0.45 () {60 vars in 1147 bytes} [Mon Aug 1 16:47:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 572 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 16:47:56.998720 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-f4321b74-3bbe-4fac-a789-4e478354cf1b tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:47:57.000284 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-f4321b74-3bbe-4fac-a789-4e478354cf1b tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] [instance: 26f3415b-3b12-4387-9477-6a900ee63f09] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:47:57.005015 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_api:SELECT=8 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:47:57.006358 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:47:57.068682 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-f4321b74-3bbe-4fac-a789-4e478354cf1b tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39593dbdff134fb1af13b341d6c01e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e1704c3b1e4729820088ca9ed48368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:47:57.076029 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-f4321b74-3bbe-4fac-a789-4e478354cf1b tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] 10.222.0.45 "GET /compute/v2.1/servers/26f3415b-3b12-4387-9477-6a900ee63f09" status: 200 len: 1218 microversion: 2.1 time: 0.081502 Aug 01 16:47:57.076624 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 484/979] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:47:56 2022] GET /compute/v2.1/servers/26f3415b-3b12-4387-9477-6a900ee63f09 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:47:58.103241 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-6398b2b6-515d-4cc2-910e-598b4664c5c1 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:47:58.105882 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-6398b2b6-515d-4cc2-910e-598b4664c5c1 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] [instance: 26f3415b-3b12-4387-9477-6a900ee63f09] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:47:58.119139 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-6398b2b6-515d-4cc2-910e-598b4664c5c1 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:47:58.119596 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-6398b2b6-515d-4cc2-910e-598b4664c5c1 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:47:58.120416 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-6398b2b6-515d-4cc2-910e-598b4664c5c1 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:47:58.120848 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-6398b2b6-515d-4cc2-910e-598b4664c5c1 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:47:58.212857 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-6398b2b6-515d-4cc2-910e-598b4664c5c1 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39593dbdff134fb1af13b341d6c01e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e1704c3b1e4729820088ca9ed48368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:47:58.222162 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-6398b2b6-515d-4cc2-910e-598b4664c5c1 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] 10.222.0.45 "GET /compute/v2.1/servers/26f3415b-3b12-4387-9477-6a900ee63f09" status: 200 len: 1288 microversion: 2.1 time: 0.127986 Aug 01 16:47:58.222740 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 496/980] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:47:58 2022] GET /compute/v2.1/servers/26f3415b-3b12-4387-9477-6a900ee63f09 => generated 1288 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:47:59.245753 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-6869ae27-797f-41e7-9791-7d1c4788b60f tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:47:59.246251 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-6869ae27-797f-41e7-9791-7d1c4788b60f tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] [instance: 26f3415b-3b12-4387-9477-6a900ee63f09] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:47:59.254271 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-6869ae27-797f-41e7-9791-7d1c4788b60f tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:47:59.254951 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-6869ae27-797f-41e7-9791-7d1c4788b60f tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:47:59.256116 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-6869ae27-797f-41e7-9791-7d1c4788b60f tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:47:59.256713 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-6869ae27-797f-41e7-9791-7d1c4788b60f tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:47:59.379057 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [req-2345279c-e52e-461c-848d-bd866611cdee req-e800c197-eaee-4b53-aae6-c51c39bb7c5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26f3415b-3b12-4387-9477-6a900ee63f09", "tag": "1828057e-bf7a-4976-a70e-6da170ba6410"}]} {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:47:59.394392 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-2345279c-e52e-461c-848d-bd866611cdee req-e800c197-eaee-4b53-aae6-c51c39bb7c5c service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:47:59.395712 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-2345279c-e52e-461c-848d-bd866611cdee req-e800c197-eaee-4b53-aae6-c51c39bb7c5c service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:47:59.414240 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.compute.server_external_events [req-2345279c-e52e-461c-848d-bd866611cdee req-e800c197-eaee-4b53-aae6-c51c39bb7c5c service nova] Creating event network-changed:1828057e-bf7a-4976-a70e-6da170ba6410 for instance 26f3415b-3b12-4387-9477-6a900ee63f09 on hv-cinder-85032 Aug 01 16:47:59.421507 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [req-2345279c-e52e-461c-848d-bd866611cdee req-e800c197-eaee-4b53-aae6-c51c39bb7c5c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048050 Aug 01 16:47:59.422838 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 497/981] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:47:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:47:59.441633 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-6869ae27-797f-41e7-9791-7d1c4788b60f tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39593dbdff134fb1af13b341d6c01e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e1704c3b1e4729820088ca9ed48368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:47:59.449973 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-6869ae27-797f-41e7-9791-7d1c4788b60f tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] 10.222.0.45 "GET /compute/v2.1/servers/26f3415b-3b12-4387-9477-6a900ee63f09" status: 200 len: 1318 microversion: 2.1 time: 0.208359 Aug 01 16:47:59.450550 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 485/982] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:47:59 2022] GET /compute/v2.1/servers/26f3415b-3b12-4387-9477-6a900ee63f09 => generated 1318 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:48:00.472316 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-ceee4586-417b-43a7-bb58-779454e752c3 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:48:00.473021 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-ceee4586-417b-43a7-bb58-779454e752c3 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] [instance: 26f3415b-3b12-4387-9477-6a900ee63f09] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:48:00.480237 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-ceee4586-417b-43a7-bb58-779454e752c3 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:48:00.480671 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-ceee4586-417b-43a7-bb58-779454e752c3 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:48:00.481453 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-ceee4586-417b-43a7-bb58-779454e752c3 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:48:00.481883 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-ceee4586-417b-43a7-bb58-779454e752c3 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:48:00.643434 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-ceee4586-417b-43a7-bb58-779454e752c3 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39593dbdff134fb1af13b341d6c01e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e1704c3b1e4729820088ca9ed48368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:48:00.652285 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-ceee4586-417b-43a7-bb58-779454e752c3 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] 10.222.0.45 "GET /compute/v2.1/servers/26f3415b-3b12-4387-9477-6a900ee63f09" status: 200 len: 1318 microversion: 2.1 time: 0.184625 Aug 01 16:48:00.652945 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 498/983] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:48:00 2022] GET /compute/v2.1/servers/26f3415b-3b12-4387-9477-6a900ee63f09 => generated 1318 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:48:01.676724 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-762027f6-8340-4495-b6aa-17c563d72c25 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:48:01.678173 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-762027f6-8340-4495-b6aa-17c563d72c25 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] [instance: 26f3415b-3b12-4387-9477-6a900ee63f09] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:48:01.684990 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-762027f6-8340-4495-b6aa-17c563d72c25 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:48:01.685822 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-762027f6-8340-4495-b6aa-17c563d72c25 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:48:01.686545 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-762027f6-8340-4495-b6aa-17c563d72c25 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:48:01.686984 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-762027f6-8340-4495-b6aa-17c563d72c25 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:48:01.831962 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-762027f6-8340-4495-b6aa-17c563d72c25 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39593dbdff134fb1af13b341d6c01e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e1704c3b1e4729820088ca9ed48368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:48:01.840918 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-762027f6-8340-4495-b6aa-17c563d72c25 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] 10.222.0.45 "GET /compute/v2.1/servers/26f3415b-3b12-4387-9477-6a900ee63f09" status: 200 len: 1318 microversion: 2.1 time: 0.168018 Aug 01 16:48:01.841788 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 486/984] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:48:01 2022] GET /compute/v2.1/servers/26f3415b-3b12-4387-9477-6a900ee63f09 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:48:02.863482 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-086a4f23-f336-4a71-964d-c6557e68612b tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:48:02.865452 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-086a4f23-f336-4a71-964d-c6557e68612b tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] [instance: 26f3415b-3b12-4387-9477-6a900ee63f09] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:48:02.872138 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-086a4f23-f336-4a71-964d-c6557e68612b tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:48:02.879367 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-086a4f23-f336-4a71-964d-c6557e68612b tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:48:02.879367 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-086a4f23-f336-4a71-964d-c6557e68612b tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:48:02.879367 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-086a4f23-f336-4a71-964d-c6557e68612b tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:48:03.022251 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-086a4f23-f336-4a71-964d-c6557e68612b tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39593dbdff134fb1af13b341d6c01e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e1704c3b1e4729820088ca9ed48368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:48:03.031577 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-086a4f23-f336-4a71-964d-c6557e68612b tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] 10.222.0.45 "GET /compute/v2.1/servers/26f3415b-3b12-4387-9477-6a900ee63f09" status: 200 len: 1318 microversion: 2.1 time: 0.172795 Aug 01 16:48:03.033227 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 499/985] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:48:02 2022] GET /compute/v2.1/servers/26f3415b-3b12-4387-9477-6a900ee63f09 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:48:04.053415 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-2a059d28-79e1-4a87-a1f4-3a8d7f195a74 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:48:04.054084 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-2a059d28-79e1-4a87-a1f4-3a8d7f195a74 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] [instance: 26f3415b-3b12-4387-9477-6a900ee63f09] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:48:04.060786 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-2a059d28-79e1-4a87-a1f4-3a8d7f195a74 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:48:04.061214 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-2a059d28-79e1-4a87-a1f4-3a8d7f195a74 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:48:04.061977 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-2a059d28-79e1-4a87-a1f4-3a8d7f195a74 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:48:04.062398 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-2a059d28-79e1-4a87-a1f4-3a8d7f195a74 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:48:04.204920 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-2a059d28-79e1-4a87-a1f4-3a8d7f195a74 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39593dbdff134fb1af13b341d6c01e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e1704c3b1e4729820088ca9ed48368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:48:04.214520 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-2a059d28-79e1-4a87-a1f4-3a8d7f195a74 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] 10.222.0.45 "GET /compute/v2.1/servers/26f3415b-3b12-4387-9477-6a900ee63f09" status: 200 len: 1318 microversion: 2.1 time: 0.164300 Aug 01 16:48:04.215349 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 487/986] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:48:04 2022] GET /compute/v2.1/servers/26f3415b-3b12-4387-9477-6a900ee63f09 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:48:04.391171 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [req-75f4e66a-902f-49b4-8808-3390e1398d6b req-f6ad2611-931c-4f91-84f1-65ea91277a7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26f3415b-3b12-4387-9477-6a900ee63f09", "name": "network-vif-plugged", "status": "completed", "tag": "1828057e-bf7a-4976-a70e-6da170ba6410"}]} {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:48:04.403827 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-75f4e66a-902f-49b4-8808-3390e1398d6b req-f6ad2611-931c-4f91-84f1-65ea91277a7d service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:48:04.405270 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-75f4e66a-902f-49b4-8808-3390e1398d6b req-f6ad2611-931c-4f91-84f1-65ea91277a7d service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:48:04.419293 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.compute.server_external_events [req-75f4e66a-902f-49b4-8808-3390e1398d6b req-f6ad2611-931c-4f91-84f1-65ea91277a7d service nova] Creating event network-vif-plugged:1828057e-bf7a-4976-a70e-6da170ba6410 for instance 26f3415b-3b12-4387-9477-6a900ee63f09 on hv-cinder-85032 Aug 01 16:48:04.424550 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [req-75f4e66a-902f-49b4-8808-3390e1398d6b req-f6ad2611-931c-4f91-84f1-65ea91277a7d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037422 Aug 01 16:48:04.425160 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 500/987] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:48:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:48:05.236470 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-9b227969-c682-4c4b-b9d8-a1ade73a9358 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:48:05.237059 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-9b227969-c682-4c4b-b9d8-a1ade73a9358 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] [instance: 26f3415b-3b12-4387-9477-6a900ee63f09] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:48:05.243973 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-9b227969-c682-4c4b-b9d8-a1ade73a9358 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:48:05.244419 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-9b227969-c682-4c4b-b9d8-a1ade73a9358 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:48:05.245231 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-9b227969-c682-4c4b-b9d8-a1ade73a9358 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:48:05.245612 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-9b227969-c682-4c4b-b9d8-a1ade73a9358 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:48:05.391553 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-9b227969-c682-4c4b-b9d8-a1ade73a9358 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39593dbdff134fb1af13b341d6c01e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e1704c3b1e4729820088ca9ed48368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:48:05.399566 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-9b227969-c682-4c4b-b9d8-a1ade73a9358 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] 10.222.0.45 "GET /compute/v2.1/servers/26f3415b-3b12-4387-9477-6a900ee63f09" status: 200 len: 1318 microversion: 2.1 time: 0.166981 Aug 01 16:48:05.400188 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 488/988] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:48:05 2022] GET /compute/v2.1/servers/26f3415b-3b12-4387-9477-6a900ee63f09 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:48:06.425276 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-4596a7bb-e531-4cc6-8515-c2a8661b5c17 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:48:06.425942 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-4596a7bb-e531-4cc6-8515-c2a8661b5c17 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] [instance: 26f3415b-3b12-4387-9477-6a900ee63f09] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:48:06.433616 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-4596a7bb-e531-4cc6-8515-c2a8661b5c17 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:48:06.434135 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-4596a7bb-e531-4cc6-8515-c2a8661b5c17 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:48:06.435116 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-4596a7bb-e531-4cc6-8515-c2a8661b5c17 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:48:06.435557 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-4596a7bb-e531-4cc6-8515-c2a8661b5c17 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:48:06.577411 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-4596a7bb-e531-4cc6-8515-c2a8661b5c17 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39593dbdff134fb1af13b341d6c01e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e1704c3b1e4729820088ca9ed48368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:48:06.586173 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-4596a7bb-e531-4cc6-8515-c2a8661b5c17 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] 10.222.0.45 "GET /compute/v2.1/servers/26f3415b-3b12-4387-9477-6a900ee63f09" status: 200 len: 1506 microversion: 2.1 time: 0.166957 Aug 01 16:48:06.586753 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 501/989] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:48:06 2022] GET /compute/v2.1/servers/26f3415b-3b12-4387-9477-6a900ee63f09 => generated 1506 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:48:06.609203 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-9a9e6759-1cbd-4000-84e2-6e67ff7c9242 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e3e797fa-8534-48af-b44b-8db48d179bf2", "device": "/dev/sdb"}} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:48:06.613553 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-9a9e6759-1cbd-4000-84e2-6e67ff7c9242 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] [instance: 26f3415b-3b12-4387-9477-6a900ee63f09] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:48:06.621164 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-9a9e6759-1cbd-4000-84e2-6e67ff7c9242 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:48:06.621603 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-9a9e6759-1cbd-4000-84e2-6e67ff7c9242 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:48:06.622362 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-9a9e6759-1cbd-4000-84e2-6e67ff7c9242 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:48:06.622785 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-9a9e6759-1cbd-4000-84e2-6e67ff7c9242 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:48:07.073205 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_cell0:SELECT=2 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:48:09.311794 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-9a9e6759-1cbd-4000-84e2-6e67ff7c9242 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] 10.222.0.45 "POST /compute/v2.1/servers/26f3415b-3b12-4387-9477-6a900ee63f09/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.708691 Aug 01 16:48:09.312519 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 489/990] 10.222.0.45 () {60 vars in 1323 bytes} [Mon Aug 1 16:48:06 2022] POST /compute/v2.1/servers/26f3415b-3b12-4387-9477-6a900ee63f09/os-volume_attachments => generated 194 bytes in 2710 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:48:26.671705 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-c1d5b1f4-e5fc-4d12-8a12-73702cc2636e tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:48:26.672342 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-c1d5b1f4-e5fc-4d12-8a12-73702cc2636e tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] [instance: 26f3415b-3b12-4387-9477-6a900ee63f09] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:48:26.678076 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_cell0:SELECT=2 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:48:26.678076 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_cell0:SELECT=6 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:48:26.678076 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:48:26.678076 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_cell1:SELECT=30 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:48:26.682811 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-c1d5b1f4-e5fc-4d12-8a12-73702cc2636e tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:48:26.683267 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-c1d5b1f4-e5fc-4d12-8a12-73702cc2636e tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:48:26.684067 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-c1d5b1f4-e5fc-4d12-8a12-73702cc2636e tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:48:26.684493 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-c1d5b1f4-e5fc-4d12-8a12-73702cc2636e tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:48:26.771289 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.objects.instance [None req-c1d5b1f4-e5fc-4d12-8a12-73702cc2636e tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lazy-loading 'services' on Instance uuid 26f3415b-3b12-4387-9477-6a900ee63f09 {{(pid=118118) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 16:48:26.848370 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-c1d5b1f4-e5fc-4d12-8a12-73702cc2636e tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] 10.222.0.45 "DELETE /compute/v2.1/servers/26f3415b-3b12-4387-9477-6a900ee63f09/os-volume_attachments/e3e797fa-8534-48af-b44b-8db48d179bf2" status: 202 len: 0 microversion: 2.1 time: 0.180583 Aug 01 16:48:26.848945 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 502/991] 10.222.0.45 () {58 vars in 1416 bytes} [Mon Aug 1 16:48:26 2022] DELETE /compute/v2.1/servers/26f3415b-3b12-4387-9477-6a900ee63f09/os-volume_attachments/e3e797fa-8534-48af-b44b-8db48d179bf2 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 16:48:27.981820 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_api:SELECT=14 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:48:27.982708 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:48:27.986852 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-190ab3bf-28e6-49a3-9567-799902238e37 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:48:27.987427 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-190ab3bf-28e6-49a3-9567-799902238e37 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] [instance: 26f3415b-3b12-4387-9477-6a900ee63f09] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:48:27.995963 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-190ab3bf-28e6-49a3-9567-799902238e37 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:48:27.996402 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-190ab3bf-28e6-49a3-9567-799902238e37 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:48:27.997164 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-190ab3bf-28e6-49a3-9567-799902238e37 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:48:27.997591 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-190ab3bf-28e6-49a3-9567-799902238e37 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:48:28.024373 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-190ab3bf-28e6-49a3-9567-799902238e37 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] [instance: 26f3415b-3b12-4387-9477-6a900ee63f09] Going to try to terminate instance {{(pid=118117) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 16:48:28.110464 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-190ab3bf-28e6-49a3-9567-799902238e37 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] 10.222.0.45 "DELETE /compute/v2.1/servers/26f3415b-3b12-4387-9477-6a900ee63f09" status: 204 len: 0 microversion: 2.1 time: 0.129718 Aug 01 16:48:28.111387 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 490/992] 10.222.0.45 () {58 vars in 1239 bytes} [Mon Aug 1 16:48:27 2022] DELETE /compute/v2.1/servers/26f3415b-3b12-4387-9477-6a900ee63f09 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 16:48:28.121110 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-f8f77af6-ef3d-46fe-97a8-3c92ac0fbdaa tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:48:28.121794 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-f8f77af6-ef3d-46fe-97a8-3c92ac0fbdaa tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] [instance: 26f3415b-3b12-4387-9477-6a900ee63f09] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:48:28.128565 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-f8f77af6-ef3d-46fe-97a8-3c92ac0fbdaa tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:48:28.129011 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-f8f77af6-ef3d-46fe-97a8-3c92ac0fbdaa tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:48:28.129809 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-f8f77af6-ef3d-46fe-97a8-3c92ac0fbdaa tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:48:28.130362 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-f8f77af6-ef3d-46fe-97a8-3c92ac0fbdaa tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:48:28.268689 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-f8f77af6-ef3d-46fe-97a8-3c92ac0fbdaa tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39593dbdff134fb1af13b341d6c01e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e1704c3b1e4729820088ca9ed48368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:48:28.277246 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-f8f77af6-ef3d-46fe-97a8-3c92ac0fbdaa tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] 10.222.0.45 "GET /compute/v2.1/servers/26f3415b-3b12-4387-9477-6a900ee63f09" status: 200 len: 1512 microversion: 2.1 time: 0.161290 Aug 01 16:48:28.277792 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 503/993] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:48:28 2022] GET /compute/v2.1/servers/26f3415b-3b12-4387-9477-6a900ee63f09 => generated 1512 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:48:29.300681 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-2536a4cc-a0c3-4203-af91-80246ba84595 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:48:29.301314 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-2536a4cc-a0c3-4203-af91-80246ba84595 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] [instance: 26f3415b-3b12-4387-9477-6a900ee63f09] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:48:29.308361 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-2536a4cc-a0c3-4203-af91-80246ba84595 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:48:29.308807 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-2536a4cc-a0c3-4203-af91-80246ba84595 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:48:29.309562 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-2536a4cc-a0c3-4203-af91-80246ba84595 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:48:29.309982 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-2536a4cc-a0c3-4203-af91-80246ba84595 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:48:29.447313 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-2536a4cc-a0c3-4203-af91-80246ba84595 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39593dbdff134fb1af13b341d6c01e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e1704c3b1e4729820088ca9ed48368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:48:29.456081 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-2536a4cc-a0c3-4203-af91-80246ba84595 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] 10.222.0.45 "GET /compute/v2.1/servers/26f3415b-3b12-4387-9477-6a900ee63f09" status: 200 len: 1512 microversion: 2.1 time: 0.159452 Aug 01 16:48:29.456648 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 491/994] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:48:29 2022] GET /compute/v2.1/servers/26f3415b-3b12-4387-9477-6a900ee63f09 => generated 1512 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:48:30.357694 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [req-90166d24-2ada-4e89-a867-0314a7607a90 req-ff5899fc-a5a9-444b-97a8-7b5fc5639857 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26f3415b-3b12-4387-9477-6a900ee63f09", "name": "network-vif-deleted", "tag": "1828057e-bf7a-4976-a70e-6da170ba6410"}]} {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:48:30.370022 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-90166d24-2ada-4e89-a867-0314a7607a90 req-ff5899fc-a5a9-444b-97a8-7b5fc5639857 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:48:30.370471 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-90166d24-2ada-4e89-a867-0314a7607a90 req-ff5899fc-a5a9-444b-97a8-7b5fc5639857 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:48:30.382590 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.compute.server_external_events [req-90166d24-2ada-4e89-a867-0314a7607a90 req-ff5899fc-a5a9-444b-97a8-7b5fc5639857 service nova] Creating event network-vif-deleted:1828057e-bf7a-4976-a70e-6da170ba6410 for instance 26f3415b-3b12-4387-9477-6a900ee63f09 on hv-cinder-85032 Aug 01 16:48:30.388398 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [req-90166d24-2ada-4e89-a867-0314a7607a90 req-ff5899fc-a5a9-444b-97a8-7b5fc5639857 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034343 Aug 01 16:48:30.389508 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 504/995] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:48:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:48:30.480255 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-9e825903-56af-437a-8544-8a19d013660a tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:48:30.480859 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-9e825903-56af-437a-8544-8a19d013660a tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] [instance: 26f3415b-3b12-4387-9477-6a900ee63f09] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:48:30.492769 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-9e825903-56af-437a-8544-8a19d013660a tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:48:30.493444 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-9e825903-56af-437a-8544-8a19d013660a tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:48:30.494162 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-9e825903-56af-437a-8544-8a19d013660a tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:48:30.494641 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-9e825903-56af-437a-8544-8a19d013660a tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:48:30.529851 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-9e825903-56af-437a-8544-8a19d013660a tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:48:30.530325 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-9e825903-56af-437a-8544-8a19d013660a tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:48:30.530748 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.objects.instance [None req-9e825903-56af-437a-8544-8a19d013660a tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lazy-loading 'fault' on Instance uuid 26f3415b-3b12-4387-9477-6a900ee63f09 {{(pid=118117) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 16:48:30.576706 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-9e825903-56af-437a-8544-8a19d013660a tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39593dbdff134fb1af13b341d6c01e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01e1704c3b1e4729820088ca9ed48368', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:48:30.585656 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-9e825903-56af-437a-8544-8a19d013660a tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] 10.222.0.45 "GET /compute/v2.1/servers/26f3415b-3b12-4387-9477-6a900ee63f09" status: 200 len: 1308 microversion: 2.1 time: 0.109508 Aug 01 16:48:30.586233 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 492/996] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:48:30 2022] GET /compute/v2.1/servers/26f3415b-3b12-4387-9477-6a900ee63f09 => generated 1308 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:48:31.607979 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-13fc0210-b3fe-461c-a816-e5494dbd53b2 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:48:31.608621 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-13fc0210-b3fe-461c-a816-e5494dbd53b2 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] [instance: 26f3415b-3b12-4387-9477-6a900ee63f09] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:48:31.616048 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-13fc0210-b3fe-461c-a816-e5494dbd53b2 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:48:31.616517 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-13fc0210-b3fe-461c-a816-e5494dbd53b2 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:48:31.617308 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-13fc0210-b3fe-461c-a816-e5494dbd53b2 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:48:31.617743 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-13fc0210-b3fe-461c-a816-e5494dbd53b2 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:48:31.632170 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.wsgi [None req-13fc0210-b3fe-461c-a816-e5494dbd53b2 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] HTTP exception thrown: Instance 26f3415b-3b12-4387-9477-6a900ee63f09 could not be found. Aug 01 16:48:31.634031 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-13fc0210-b3fe-461c-a816-e5494dbd53b2 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Request method failure captured: Aug 01 16:48:31.634031 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: request: GET /compute/v2.1/servers/26f3415b-3b12-4387-9477-6a900ee63f09 HTTP/1.1 Aug 01 16:48:31.634031 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Accept: application/json Aug 01 16:48:31.634031 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Accept-Encoding: identity Aug 01 16:48:31.634031 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Connection: close Aug 01 16:48:31.634031 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Content-Length: 0 Aug 01 16:48:31.634031 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Content-Type: application/json Aug 01 16:48:31.634031 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Host: 10.222.0.45 Aug 01 16:48:31.634031 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Openstack-System-Scope: None Aug 01 16:48:31.634031 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: User-Agent: python-urllib3/1.26.10 Aug 01 16:48:31.634031 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Auth-Token: gAAAAABi6AN1MsmnEFLRCT-Zc5TwOcqMKKm8N_uLmPMXRTTHZ1-Mz6sfEig6834kuSDnmW2grrMUhwhSraPLz5uneVh5je_C3LJxOrP6IhgZhI8bL0Sh-iUAPBmPPpEWj7qmOD1jxOZc1i2vdsAfnx7da5pORW8XDbpJN_PArahVfeBmEplXGvc Aug 01 16:48:31.634031 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Domain-Id: None Aug 01 16:48:31.634031 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Domain-Name: None Aug 01 16:48:31.634031 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Identity-Status: Confirmed Aug 01 16:48:31.634031 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Is-Admin-Project: True Aug 01 16:48:31.634031 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Domain-Id: default Aug 01 16:48:31.634031 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Domain-Name: Default Aug 01 16:48:31.634031 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Id: 01e1704c3b1e4729820088ca9ed48368 Aug 01 16:48:31.634031 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1063588417 Aug 01 16:48:31.634031 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Role: reader,member Aug 01 16:48:31.634031 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Roles: reader,member Aug 01 16:48:31.635851 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_01e1704c3b1e4729820088ca9ed48368"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/01e1704c3b1e4729820088ca9ed48368"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/01e1704c3b1e4729820088ca9ed48368"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/01e1704c3b1e4729820088ca9ed48368"}]}] Aug 01 16:48:31.635851 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant: tempest-VolumesSnapshotTestJSON-1063588417 Aug 01 16:48:31.635851 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant-Id: 01e1704c3b1e4729820088ca9ed48368 Aug 01 16:48:31.635851 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1063588417 Aug 01 16:48:31.635851 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User: tempest-VolumesSnapshotTestJSON-1063588417-project Aug 01 16:48:31.635851 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Domain-Id: default Aug 01 16:48:31.635851 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Domain-Name: Default Aug 01 16:48:31.635851 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Id: 39593dbdff134fb1af13b341d6c01e37 Aug 01 16:48:31.635851 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Name: tempest-VolumesSnapshotTestJSON-1063588417-project Aug 01 16:48:31.635851 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: method: > Aug 01 16:48:31.635851 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: exception: Instance 26f3415b-3b12-4387-9477-6a900ee63f09 could not be found. Aug 01 16:48:31.635851 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: action_args: {'id': '26f3415b-3b12-4387-9477-6a900ee63f09'} Aug 01 16:48:31.636756 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:48:31.636756 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:48:31.636756 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 16:48:31.636756 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 16:48:31.636756 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 16:48:31.636756 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 16:48:31.636756 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 16:48:31.636756 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 16:48:31.636756 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 16:48:31.636756 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 16:48:31.636756 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26f3415b-3b12-4387-9477-6a900ee63f09 could not be found. Aug 01 16:48:31.636756 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:48:31.636756 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:48:31.636756 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:48:31.636756 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:48:31.636756 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:48:31.636756 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:48:31.636756 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:48:31.636756 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:48:31.636756 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:48:31.638231 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:48:31.638231 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 16:48:31.638231 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 16:48:31.638231 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 16:48:31.638231 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 16:48:31.638231 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 16:48:31.638231 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:48:31.638231 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26f3415b-3b12-4387-9477-6a900ee63f09 could not be found. Aug 01 16:48:31.638231 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:48:31.638231 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:48:31.638231 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:48:31.638231 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:48:31.638231 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:48:31.638231 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:48:31.638231 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:48:31.638231 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:48:31.638231 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26f3415b-3b12-4387-9477-6a900ee63f09 could not be found. Aug 01 16:48:31.638231 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:48:31.639698 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-13fc0210-b3fe-461c-a816-e5494dbd53b2 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] Returning 404 to user: Instance 26f3415b-3b12-4387-9477-6a900ee63f09 could not be found. {{(pid=118118) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:48:31.639698 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-13fc0210-b3fe-461c-a816-e5494dbd53b2 tempest-VolumesSnapshotTestJSON-1063588417 tempest-VolumesSnapshotTestJSON-1063588417-project] 10.222.0.45 "GET /compute/v2.1/servers/26f3415b-3b12-4387-9477-6a900ee63f09" status: 404 len: 111 microversion: 2.1 time: 0.032328 Aug 01 16:48:31.639698 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 505/997] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:48:31 2022] GET /compute/v2.1/servers/26f3415b-3b12-4387-9477-6a900ee63f09 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 16:48:41.641192 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-50f91b41-1a5c-4a51-9a85-2930021d38c0 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-993447949", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1173141553", "security_groups": [{"name": "tempest-secgroup-smoke-1642957585"}], "block_device_mapping_v2": [{"uuid": "1c3ccb96-bfbd-41b7-a5a1-0da2c49bdf35", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f2f38df7-15f3-4c49-abb4-95c1ce8da0a5"}]}} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:48:41.651676 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:48:41.652357 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:48:41.766249 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.network.neutron [None req-50f91b41-1a5c-4a51-9a85-2930021d38c0 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] validate_networks() for [('f2f38df7-15f3-4c49-abb4-95c1ce8da0a5', None, None, None, None, None)] {{(pid=118117) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 16:48:42.158089 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.virt.hardware [None req-50f91b41-1a5c-4a51-9a85-2930021d38c0 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Flavor limits 0:0:0 {{(pid=118117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 16:48:42.158580 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.virt.hardware [None req-50f91b41-1a5c-4a51-9a85-2930021d38c0 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Image limits 0:0:0 {{(pid=118117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 16:48:42.159128 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.virt.hardware [None req-50f91b41-1a5c-4a51-9a85-2930021d38c0 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Flavor pref 0:0:0 {{(pid=118117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 16:48:42.159603 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.virt.hardware [None req-50f91b41-1a5c-4a51-9a85-2930021d38c0 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Image pref 0:0:0 {{(pid=118117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 16:48:42.160179 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.virt.hardware [None req-50f91b41-1a5c-4a51-9a85-2930021d38c0 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 16:48:42.170778 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-50f91b41-1a5c-4a51-9a85-2930021d38c0 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:48:42.171228 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-50f91b41-1a5c-4a51-9a85-2930021d38c0 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:48:42.172205 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-50f91b41-1a5c-4a51-9a85-2930021d38c0 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:48:42.172640 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-50f91b41-1a5c-4a51-9a85-2930021d38c0 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:48:42.189613 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.quota [None req-50f91b41-1a5c-4a51-9a85-2930021d38c0 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Getting quotas for project c86fcc5e23854dfba97058deac8211d0. Resources: {'cores', 'ram', 'instances'} {{(pid=118117) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 16:48:42.194121 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.quota [None req-50f91b41-1a5c-4a51-9a85-2930021d38c0 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Getting quotas for user 22cfd17a6f434deca7ef77253ae3ed2f and project c86fcc5e23854dfba97058deac8211d0. Resources: {'cores', 'ram', 'instances'} {{(pid=118117) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 16:48:42.263960 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-50f91b41-1a5c-4a51-9a85-2930021d38c0 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Going to run 1 instances... {{(pid=118117) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 16:48:42.266389 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-50f91b41-1a5c-4a51-9a85-2930021d38c0 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] [instance: 32799c1b-c5eb-4c06-af44-da8810a0cbcb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1c3ccb96-bfbd-41b7-a5a1-0da2c49bdf35',volume_size=None,volume_type=None)] {{(pid=118117) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 16:48:42.411084 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-50f91b41-1a5c-4a51-9a85-2930021d38c0 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.773602 Aug 01 16:48:42.411825 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 493/998] 10.222.0.45 () {60 vars in 1147 bytes} [Mon Aug 1 16:48:41 2022] POST /compute/v2.1/servers => generated 406 bytes in 775 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 01 16:48:42.429270 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-a74cb966-c37c-44c8-bb22-bfb73b704af1 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:48:42.429869 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-a74cb966-c37c-44c8-bb22-bfb73b704af1 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] [instance: 32799c1b-c5eb-4c06-af44-da8810a0cbcb] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:48:42.432553 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_api:SELECT=8 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:48:42.433624 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:48:42.491506 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-a74cb966-c37c-44c8-bb22-bfb73b704af1 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22cfd17a6f434deca7ef77253ae3ed2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86fcc5e23854dfba97058deac8211d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:48:42.498630 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-a74cb966-c37c-44c8-bb22-bfb73b704af1 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] 10.222.0.45 "GET /compute/v2.1/servers/32799c1b-c5eb-4c06-af44-da8810a0cbcb" status: 200 len: 1094 microversion: 2.1 time: 0.078053 Aug 01 16:48:42.499231 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 506/999] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:48:42 2022] GET /compute/v2.1/servers/32799c1b-c5eb-4c06-af44-da8810a0cbcb => generated 1094 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:48:43.520905 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-17cf5bcf-9b82-4450-8049-5e61d624dad9 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:48:43.530243 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-17cf5bcf-9b82-4450-8049-5e61d624dad9 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] [instance: 32799c1b-c5eb-4c06-af44-da8810a0cbcb] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:48:43.537694 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-17cf5bcf-9b82-4450-8049-5e61d624dad9 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:48:43.538564 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-17cf5bcf-9b82-4450-8049-5e61d624dad9 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:48:43.539829 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-17cf5bcf-9b82-4450-8049-5e61d624dad9 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:48:43.540413 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-17cf5bcf-9b82-4450-8049-5e61d624dad9 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:48:43.615083 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-17cf5bcf-9b82-4450-8049-5e61d624dad9 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22cfd17a6f434deca7ef77253ae3ed2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86fcc5e23854dfba97058deac8211d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:48:43.623739 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-17cf5bcf-9b82-4450-8049-5e61d624dad9 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] 10.222.0.45 "GET /compute/v2.1/servers/32799c1b-c5eb-4c06-af44-da8810a0cbcb" status: 200 len: 1210 microversion: 2.1 time: 0.107505 Aug 01 16:48:43.624352 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 494/1000] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:48:43 2022] GET /compute/v2.1/servers/32799c1b-c5eb-4c06-af44-da8810a0cbcb => generated 1210 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:48:44.645510 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-a448cf99-e728-4d34-bb3a-bbcfc6495bb0 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:48:44.646090 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-a448cf99-e728-4d34-bb3a-bbcfc6495bb0 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] [instance: 32799c1b-c5eb-4c06-af44-da8810a0cbcb] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:48:44.654351 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a448cf99-e728-4d34-bb3a-bbcfc6495bb0 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:48:44.654728 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a448cf99-e728-4d34-bb3a-bbcfc6495bb0 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:48:44.655493 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a448cf99-e728-4d34-bb3a-bbcfc6495bb0 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:48:44.655998 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a448cf99-e728-4d34-bb3a-bbcfc6495bb0 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:48:44.790767 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-a448cf99-e728-4d34-bb3a-bbcfc6495bb0 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22cfd17a6f434deca7ef77253ae3ed2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86fcc5e23854dfba97058deac8211d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:48:44.798673 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-a448cf99-e728-4d34-bb3a-bbcfc6495bb0 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] 10.222.0.45 "GET /compute/v2.1/servers/32799c1b-c5eb-4c06-af44-da8810a0cbcb" status: 200 len: 1278 microversion: 2.1 time: 0.157460 Aug 01 16:48:44.799239 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 507/1001] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:48:44 2022] GET /compute/v2.1/servers/32799c1b-c5eb-4c06-af44-da8810a0cbcb => generated 1278 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:48:45.820439 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-bb5eae93-ef59-4b21-b7d7-be3e7d4ba50a tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:48:45.821223 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-bb5eae93-ef59-4b21-b7d7-be3e7d4ba50a tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] [instance: 32799c1b-c5eb-4c06-af44-da8810a0cbcb] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:48:45.828087 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-bb5eae93-ef59-4b21-b7d7-be3e7d4ba50a tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:48:45.828521 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-bb5eae93-ef59-4b21-b7d7-be3e7d4ba50a tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:48:45.829268 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-bb5eae93-ef59-4b21-b7d7-be3e7d4ba50a tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:48:45.829836 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-bb5eae93-ef59-4b21-b7d7-be3e7d4ba50a tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:48:45.975896 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-bb5eae93-ef59-4b21-b7d7-be3e7d4ba50a tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22cfd17a6f434deca7ef77253ae3ed2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86fcc5e23854dfba97058deac8211d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:48:45.984612 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-bb5eae93-ef59-4b21-b7d7-be3e7d4ba50a tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] 10.222.0.45 "GET /compute/v2.1/servers/32799c1b-c5eb-4c06-af44-da8810a0cbcb" status: 200 len: 1278 microversion: 2.1 time: 0.168361 Aug 01 16:48:45.985200 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 495/1002] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:48:45 2022] GET /compute/v2.1/servers/32799c1b-c5eb-4c06-af44-da8810a0cbcb => generated 1278 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:48:46.084071 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [req-101ed3ec-15fc-4edf-9b74-e25d86ab59e2 req-8d6985c8-a97f-4d86-8b80-ce76b6101238 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32799c1b-c5eb-4c06-af44-da8810a0cbcb", "tag": "56ab5dda-abf7-466e-8d30-ed0735a4a925"}]} {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:48:46.094887 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-101ed3ec-15fc-4edf-9b74-e25d86ab59e2 req-8d6985c8-a97f-4d86-8b80-ce76b6101238 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:48:46.095423 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-101ed3ec-15fc-4edf-9b74-e25d86ab59e2 req-8d6985c8-a97f-4d86-8b80-ce76b6101238 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:48:46.106641 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.compute.server_external_events [req-101ed3ec-15fc-4edf-9b74-e25d86ab59e2 req-8d6985c8-a97f-4d86-8b80-ce76b6101238 service nova] Creating event network-changed:56ab5dda-abf7-466e-8d30-ed0735a4a925 for instance 32799c1b-c5eb-4c06-af44-da8810a0cbcb on hv-cinder-85032 Aug 01 16:48:46.111963 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [req-101ed3ec-15fc-4edf-9b74-e25d86ab59e2 req-8d6985c8-a97f-4d86-8b80-ce76b6101238 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031752 Aug 01 16:48:46.112561 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 508/1003] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:48:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:48:47.007240 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-5ce8e434-e993-4ff6-82b0-79038810de5d tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:48:47.008015 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-5ce8e434-e993-4ff6-82b0-79038810de5d tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] [instance: 32799c1b-c5eb-4c06-af44-da8810a0cbcb] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:48:47.015264 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-5ce8e434-e993-4ff6-82b0-79038810de5d tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:48:47.015694 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-5ce8e434-e993-4ff6-82b0-79038810de5d tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:48:47.016706 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-5ce8e434-e993-4ff6-82b0-79038810de5d tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:48:47.017132 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-5ce8e434-e993-4ff6-82b0-79038810de5d tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:48:47.166912 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-5ce8e434-e993-4ff6-82b0-79038810de5d tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22cfd17a6f434deca7ef77253ae3ed2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86fcc5e23854dfba97058deac8211d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:48:47.175121 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-5ce8e434-e993-4ff6-82b0-79038810de5d tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] 10.222.0.45 "GET /compute/v2.1/servers/32799c1b-c5eb-4c06-af44-da8810a0cbcb" status: 200 len: 1278 microversion: 2.1 time: 0.172767 Aug 01 16:48:47.175670 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 496/1004] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:48:47 2022] GET /compute/v2.1/servers/32799c1b-c5eb-4c06-af44-da8810a0cbcb => generated 1278 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:48:48.200374 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-1b40afd3-5f93-497e-943a-6adb17408633 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:48:48.201074 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-1b40afd3-5f93-497e-943a-6adb17408633 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] [instance: 32799c1b-c5eb-4c06-af44-da8810a0cbcb] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:48:48.207363 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-1b40afd3-5f93-497e-943a-6adb17408633 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:48:48.207817 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-1b40afd3-5f93-497e-943a-6adb17408633 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:48:48.208589 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-1b40afd3-5f93-497e-943a-6adb17408633 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:48:48.209173 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-1b40afd3-5f93-497e-943a-6adb17408633 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:48:48.361927 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-1b40afd3-5f93-497e-943a-6adb17408633 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22cfd17a6f434deca7ef77253ae3ed2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86fcc5e23854dfba97058deac8211d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:48:48.370385 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-1b40afd3-5f93-497e-943a-6adb17408633 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] 10.222.0.45 "GET /compute/v2.1/servers/32799c1b-c5eb-4c06-af44-da8810a0cbcb" status: 200 len: 1266 microversion: 2.1 time: 0.174984 Aug 01 16:48:48.370964 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 509/1005] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:48:48 2022] GET /compute/v2.1/servers/32799c1b-c5eb-4c06-af44-da8810a0cbcb => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:48:49.392384 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-6451b599-abbd-4d63-bfd1-dca6fc60ab67 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:48:49.393003 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-6451b599-abbd-4d63-bfd1-dca6fc60ab67 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] [instance: 32799c1b-c5eb-4c06-af44-da8810a0cbcb] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:48:49.400127 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-6451b599-abbd-4d63-bfd1-dca6fc60ab67 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:48:49.400578 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-6451b599-abbd-4d63-bfd1-dca6fc60ab67 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:48:49.401344 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-6451b599-abbd-4d63-bfd1-dca6fc60ab67 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:48:49.401774 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-6451b599-abbd-4d63-bfd1-dca6fc60ab67 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:48:49.549187 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-6451b599-abbd-4d63-bfd1-dca6fc60ab67 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22cfd17a6f434deca7ef77253ae3ed2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86fcc5e23854dfba97058deac8211d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:48:49.557540 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-6451b599-abbd-4d63-bfd1-dca6fc60ab67 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] 10.222.0.45 "GET /compute/v2.1/servers/32799c1b-c5eb-4c06-af44-da8810a0cbcb" status: 200 len: 1266 microversion: 2.1 time: 0.169368 Aug 01 16:48:49.558126 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 497/1006] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:48:49 2022] GET /compute/v2.1/servers/32799c1b-c5eb-4c06-af44-da8810a0cbcb => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:48:50.578250 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-5d1ba4ac-9f0e-4281-9e8a-90ad37949f97 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:48:50.578911 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-5d1ba4ac-9f0e-4281-9e8a-90ad37949f97 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] [instance: 32799c1b-c5eb-4c06-af44-da8810a0cbcb] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:48:50.586079 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-5d1ba4ac-9f0e-4281-9e8a-90ad37949f97 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:48:50.586532 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-5d1ba4ac-9f0e-4281-9e8a-90ad37949f97 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:48:50.587301 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-5d1ba4ac-9f0e-4281-9e8a-90ad37949f97 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:48:50.587770 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-5d1ba4ac-9f0e-4281-9e8a-90ad37949f97 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:48:50.726786 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-5d1ba4ac-9f0e-4281-9e8a-90ad37949f97 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22cfd17a6f434deca7ef77253ae3ed2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86fcc5e23854dfba97058deac8211d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:48:50.734610 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-5d1ba4ac-9f0e-4281-9e8a-90ad37949f97 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] 10.222.0.45 "GET /compute/v2.1/servers/32799c1b-c5eb-4c06-af44-da8810a0cbcb" status: 200 len: 1266 microversion: 2.1 time: 0.160496 Aug 01 16:48:50.735205 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 510/1007] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:48:50 2022] GET /compute/v2.1/servers/32799c1b-c5eb-4c06-af44-da8810a0cbcb => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:48:51.756113 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-3b78ae88-c681-475d-9c98-27fe6e6c1bf0 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:48:51.757809 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-3b78ae88-c681-475d-9c98-27fe6e6c1bf0 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] [instance: 32799c1b-c5eb-4c06-af44-da8810a0cbcb] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:48:51.765013 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-3b78ae88-c681-475d-9c98-27fe6e6c1bf0 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:48:51.765461 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-3b78ae88-c681-475d-9c98-27fe6e6c1bf0 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:48:51.766234 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-3b78ae88-c681-475d-9c98-27fe6e6c1bf0 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:48:51.766662 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-3b78ae88-c681-475d-9c98-27fe6e6c1bf0 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:48:51.904944 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-3b78ae88-c681-475d-9c98-27fe6e6c1bf0 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22cfd17a6f434deca7ef77253ae3ed2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86fcc5e23854dfba97058deac8211d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:48:51.913585 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-3b78ae88-c681-475d-9c98-27fe6e6c1bf0 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] 10.222.0.45 "GET /compute/v2.1/servers/32799c1b-c5eb-4c06-af44-da8810a0cbcb" status: 200 len: 1266 microversion: 2.1 time: 0.161973 Aug 01 16:48:51.914176 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 498/1008] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:48:51 2022] GET /compute/v2.1/servers/32799c1b-c5eb-4c06-af44-da8810a0cbcb => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:48:52.935069 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-c8b6b8ed-0676-4838-b9b3-91c7d8fee8d1 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:48:52.935875 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-c8b6b8ed-0676-4838-b9b3-91c7d8fee8d1 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] [instance: 32799c1b-c5eb-4c06-af44-da8810a0cbcb] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:48:52.938159 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_cell0:SELECT=2 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:48:52.944401 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-c8b6b8ed-0676-4838-b9b3-91c7d8fee8d1 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:48:52.944842 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-c8b6b8ed-0676-4838-b9b3-91c7d8fee8d1 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:48:52.945622 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-c8b6b8ed-0676-4838-b9b3-91c7d8fee8d1 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:48:52.946040 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-c8b6b8ed-0676-4838-b9b3-91c7d8fee8d1 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:48:53.100426 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-c8b6b8ed-0676-4838-b9b3-91c7d8fee8d1 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22cfd17a6f434deca7ef77253ae3ed2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86fcc5e23854dfba97058deac8211d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:48:53.108630 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-c8b6b8ed-0676-4838-b9b3-91c7d8fee8d1 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] 10.222.0.45 "GET /compute/v2.1/servers/32799c1b-c5eb-4c06-af44-da8810a0cbcb" status: 200 len: 1266 microversion: 2.1 time: 0.177638 Aug 01 16:48:53.109203 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 511/1009] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:48:52 2022] GET /compute/v2.1/servers/32799c1b-c5eb-4c06-af44-da8810a0cbcb => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:48:54.129857 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-6e17c5ec-5ca8-471e-b44d-aee59e64861d tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:48:54.130439 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-6e17c5ec-5ca8-471e-b44d-aee59e64861d tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] [instance: 32799c1b-c5eb-4c06-af44-da8810a0cbcb] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:48:54.132590 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_cell0:SELECT=2 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:48:54.133220 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_cell0:SELECT=6 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:48:54.140137 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-6e17c5ec-5ca8-471e-b44d-aee59e64861d tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:48:54.140576 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-6e17c5ec-5ca8-471e-b44d-aee59e64861d tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:48:54.141323 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-6e17c5ec-5ca8-471e-b44d-aee59e64861d tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:48:54.141749 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-6e17c5ec-5ca8-471e-b44d-aee59e64861d tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:48:54.279403 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-6e17c5ec-5ca8-471e-b44d-aee59e64861d tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22cfd17a6f434deca7ef77253ae3ed2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86fcc5e23854dfba97058deac8211d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:48:54.287616 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-6e17c5ec-5ca8-471e-b44d-aee59e64861d tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] 10.222.0.45 "GET /compute/v2.1/servers/32799c1b-c5eb-4c06-af44-da8810a0cbcb" status: 200 len: 1266 microversion: 2.1 time: 0.161560 Aug 01 16:48:54.288207 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 499/1010] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:48:54 2022] GET /compute/v2.1/servers/32799c1b-c5eb-4c06-af44-da8810a0cbcb => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:48:55.310087 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-f03cfbe0-ff6f-4161-943e-0e6f1c9affda tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:48:55.310730 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-f03cfbe0-ff6f-4161-943e-0e6f1c9affda tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] [instance: 32799c1b-c5eb-4c06-af44-da8810a0cbcb] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:48:55.318110 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-f03cfbe0-ff6f-4161-943e-0e6f1c9affda tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:48:55.318703 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-f03cfbe0-ff6f-4161-943e-0e6f1c9affda tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:48:55.319976 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-f03cfbe0-ff6f-4161-943e-0e6f1c9affda tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:48:55.320422 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-f03cfbe0-ff6f-4161-943e-0e6f1c9affda tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:48:55.467531 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-f03cfbe0-ff6f-4161-943e-0e6f1c9affda tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22cfd17a6f434deca7ef77253ae3ed2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86fcc5e23854dfba97058deac8211d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:48:55.476135 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-f03cfbe0-ff6f-4161-943e-0e6f1c9affda tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] 10.222.0.45 "GET /compute/v2.1/servers/32799c1b-c5eb-4c06-af44-da8810a0cbcb" status: 200 len: 1266 microversion: 2.1 time: 0.170423 Aug 01 16:48:55.476732 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 512/1011] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:48:55 2022] GET /compute/v2.1/servers/32799c1b-c5eb-4c06-af44-da8810a0cbcb => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:48:56.497486 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-89056d5f-84d1-4223-b05c-ab123db7bae5 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:48:56.498767 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-89056d5f-84d1-4223-b05c-ab123db7bae5 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] [instance: 32799c1b-c5eb-4c06-af44-da8810a0cbcb] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:48:56.506364 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-89056d5f-84d1-4223-b05c-ab123db7bae5 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:48:56.506868 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-89056d5f-84d1-4223-b05c-ab123db7bae5 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:48:56.507711 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-89056d5f-84d1-4223-b05c-ab123db7bae5 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:48:56.508336 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-89056d5f-84d1-4223-b05c-ab123db7bae5 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:48:56.617735 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [req-f4d8d208-0eee-4a31-b869-f638f73b1732 req-393ac2ad-e8b8-41f3-bd10-fae04a45e081 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32799c1b-c5eb-4c06-af44-da8810a0cbcb", "name": "network-vif-plugged", "status": "completed", "tag": "56ab5dda-abf7-466e-8d30-ed0735a4a925"}]} {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:48:56.629230 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-f4d8d208-0eee-4a31-b869-f638f73b1732 req-393ac2ad-e8b8-41f3-bd10-fae04a45e081 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:48:56.629762 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-f4d8d208-0eee-4a31-b869-f638f73b1732 req-393ac2ad-e8b8-41f3-bd10-fae04a45e081 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:48:56.642999 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.compute.server_external_events [req-f4d8d208-0eee-4a31-b869-f638f73b1732 req-393ac2ad-e8b8-41f3-bd10-fae04a45e081 service nova] Creating event network-vif-plugged:56ab5dda-abf7-466e-8d30-ed0735a4a925 for instance 32799c1b-c5eb-4c06-af44-da8810a0cbcb on hv-cinder-85032 Aug 01 16:48:56.653766 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [req-f4d8d208-0eee-4a31-b869-f638f73b1732 req-393ac2ad-e8b8-41f3-bd10-fae04a45e081 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040855 Aug 01 16:48:56.654561 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 513/1012] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:48:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 16:48:56.658415 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-89056d5f-84d1-4223-b05c-ab123db7bae5 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22cfd17a6f434deca7ef77253ae3ed2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86fcc5e23854dfba97058deac8211d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:48:56.676221 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-89056d5f-84d1-4223-b05c-ab123db7bae5 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] 10.222.0.45 "GET /compute/v2.1/servers/32799c1b-c5eb-4c06-af44-da8810a0cbcb" status: 200 len: 1266 microversion: 2.1 time: 0.182677 Aug 01 16:48:56.676815 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 500/1013] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:48:56 2022] GET /compute/v2.1/servers/32799c1b-c5eb-4c06-af44-da8810a0cbcb => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:48:57.699465 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-17d1293c-f76c-4333-8a1c-00395b438b7f tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:48:57.700275 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-17d1293c-f76c-4333-8a1c-00395b438b7f tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] [instance: 32799c1b-c5eb-4c06-af44-da8810a0cbcb] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:48:57.707358 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-17d1293c-f76c-4333-8a1c-00395b438b7f tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:48:57.707786 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-17d1293c-f76c-4333-8a1c-00395b438b7f tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:48:57.708606 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-17d1293c-f76c-4333-8a1c-00395b438b7f tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:48:57.709032 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-17d1293c-f76c-4333-8a1c-00395b438b7f tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:48:57.854691 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-17d1293c-f76c-4333-8a1c-00395b438b7f tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22cfd17a6f434deca7ef77253ae3ed2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86fcc5e23854dfba97058deac8211d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:48:57.869591 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-17d1293c-f76c-4333-8a1c-00395b438b7f tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] 10.222.0.45 "GET /compute/v2.1/servers/32799c1b-c5eb-4c06-af44-da8810a0cbcb" status: 200 len: 1266 microversion: 2.1 time: 0.174751 Aug 01 16:48:57.870223 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 514/1014] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:48:57 2022] GET /compute/v2.1/servers/32799c1b-c5eb-4c06-af44-da8810a0cbcb => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:48:58.890503 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-72db3bb8-8871-4000-bc54-e9a7c1a2157b tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:48:58.891172 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-72db3bb8-8871-4000-bc54-e9a7c1a2157b tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] [instance: 32799c1b-c5eb-4c06-af44-da8810a0cbcb] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:48:58.899513 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-72db3bb8-8871-4000-bc54-e9a7c1a2157b tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:48:58.900338 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-72db3bb8-8871-4000-bc54-e9a7c1a2157b tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:48:58.900895 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-72db3bb8-8871-4000-bc54-e9a7c1a2157b tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:48:58.901382 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-72db3bb8-8871-4000-bc54-e9a7c1a2157b tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:48:59.054545 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-72db3bb8-8871-4000-bc54-e9a7c1a2157b tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22cfd17a6f434deca7ef77253ae3ed2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86fcc5e23854dfba97058deac8211d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:48:59.062608 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-72db3bb8-8871-4000-bc54-e9a7c1a2157b tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] 10.222.0.45 "GET /compute/v2.1/servers/32799c1b-c5eb-4c06-af44-da8810a0cbcb" status: 200 len: 1453 microversion: 2.1 time: 0.175924 Aug 01 16:48:59.063194 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 501/1015] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:48:58 2022] GET /compute/v2.1/servers/32799c1b-c5eb-4c06-af44-da8810a0cbcb => generated 1453 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:48:59.083159 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-e9385a41-977e-4739-982a-83185327597e tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:48:59.083793 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-e9385a41-977e-4739-982a-83185327597e tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] [instance: 32799c1b-c5eb-4c06-af44-da8810a0cbcb] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:48:59.091334 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-e9385a41-977e-4739-982a-83185327597e tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:48:59.092920 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-e9385a41-977e-4739-982a-83185327597e tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:48:59.092920 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-e9385a41-977e-4739-982a-83185327597e tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:48:59.093637 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-e9385a41-977e-4739-982a-83185327597e tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:48:59.232063 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-e9385a41-977e-4739-982a-83185327597e tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22cfd17a6f434deca7ef77253ae3ed2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86fcc5e23854dfba97058deac8211d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:48:59.240161 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-e9385a41-977e-4739-982a-83185327597e tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] 10.222.0.45 "GET /compute/v2.1/servers/32799c1b-c5eb-4c06-af44-da8810a0cbcb" status: 200 len: 1453 microversion: 2.1 time: 0.160768 Aug 01 16:48:59.241232 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 515/1016] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:48:59 2022] GET /compute/v2.1/servers/32799c1b-c5eb-4c06-af44-da8810a0cbcb => generated 1453 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:49:01.436112 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [req-b724dc7a-daad-42e4-b85f-914f10ebec33 req-dc77b076-acd6-4b72-9f11-02b57764b568 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32799c1b-c5eb-4c06-af44-da8810a0cbcb", "tag": "56ab5dda-abf7-466e-8d30-ed0735a4a925"}]} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:49:01.451937 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-b724dc7a-daad-42e4-b85f-914f10ebec33 req-dc77b076-acd6-4b72-9f11-02b57764b568 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:49:01.452754 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-b724dc7a-daad-42e4-b85f-914f10ebec33 req-dc77b076-acd6-4b72-9f11-02b57764b568 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:49:01.467517 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.compute.server_external_events [req-b724dc7a-daad-42e4-b85f-914f10ebec33 req-dc77b076-acd6-4b72-9f11-02b57764b568 service nova] Creating event network-changed:56ab5dda-abf7-466e-8d30-ed0735a4a925 for instance 32799c1b-c5eb-4c06-af44-da8810a0cbcb on hv-cinder-85032 Aug 01 16:49:01.475650 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [req-b724dc7a-daad-42e4-b85f-914f10ebec33 req-dc77b076-acd6-4b72-9f11-02b57764b568 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043332 Aug 01 16:49:01.482065 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 502/1017] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:49:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:49:09.091420 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_api:SELECT=22 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:09.114002 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-6f73bfa4-cf72-4072-9762-fe985339fadd tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Action: 'create', calling method: .version_select at 0x7efd674280d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-2053706543", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNoMH3jnBSROUEb1ZbjNUGBlz4GsoUUNHHJ3b2fGxY74ZSR4tE7rrq/JaMYWavGGxfapQv39rBsYi2Da7kto6NUNpe+U4XxmBNFtVYmCOBpOcZiXEW3W2OEuSHFLWE/UrQ=="}} {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:49:09.138363 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.quota [None req-6f73bfa4-cf72-4072-9762-fe985339fadd tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Getting quotas for project b6154357c0184a0cb61602f2f110b1d7. Resources: {'key_pairs'} {{(pid=118118) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 16:49:09.144733 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.quota [None req-6f73bfa4-cf72-4072-9762-fe985339fadd tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Getting quotas for user cc52fbd78dce4bbdada6305efb327264 and project b6154357c0184a0cb61602f2f110b1d7. Resources: {'key_pairs'} {{(pid=118118) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 16:49:09.171919 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-6f73bfa4-cf72-4072-9762-fe985339fadd tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.310419 Aug 01 16:49:09.172630 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 516/1018] 10.222.0.45 () {60 vars in 1159 bytes} [Mon Aug 1 16:49:08 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 16:49:25.520068 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:25.520802 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_cell1:SELECT=52 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:25.525547 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-59e0215e-1651-438b-8c6b-5c70c37b2241 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-666044233", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2053706543", "security_groups": [{"name": "tempest-secgroup-smoke-1815855060"}], "networks": [{"uuid": "72c5e7e8-09c9-4618-8af5-191565059a51"}], "block_device_mapping_v2": [{"uuid": "33b90821-80a4-4973-857c-1cbc2a40783b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:49:25.764751 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.network.neutron [None req-59e0215e-1651-438b-8c6b-5c70c37b2241 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] validate_networks() for [('72c5e7e8-09c9-4618-8af5-191565059a51', None, None, None, None, None)] {{(pid=118117) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 16:49:26.487956 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.virt.hardware [None req-59e0215e-1651-438b-8c6b-5c70c37b2241 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Flavor limits 0:0:0 {{(pid=118117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 16:49:26.488378 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.virt.hardware [None req-59e0215e-1651-438b-8c6b-5c70c37b2241 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Image limits 0:0:0 {{(pid=118117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 16:49:26.488900 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.virt.hardware [None req-59e0215e-1651-438b-8c6b-5c70c37b2241 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Flavor pref 0:0:0 {{(pid=118117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 16:49:26.489312 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.virt.hardware [None req-59e0215e-1651-438b-8c6b-5c70c37b2241 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Image pref 0:0:0 {{(pid=118117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 16:49:26.489719 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.virt.hardware [None req-59e0215e-1651-438b-8c6b-5c70c37b2241 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118117) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 16:49:26.500759 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-59e0215e-1651-438b-8c6b-5c70c37b2241 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:49:26.501210 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-59e0215e-1651-438b-8c6b-5c70c37b2241 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:49:26.502025 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-59e0215e-1651-438b-8c6b-5c70c37b2241 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:49:26.502492 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-59e0215e-1651-438b-8c6b-5c70c37b2241 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:49:26.522094 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.quota [None req-59e0215e-1651-438b-8c6b-5c70c37b2241 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Getting quotas for project b6154357c0184a0cb61602f2f110b1d7. Resources: {'cores', 'ram', 'instances'} {{(pid=118117) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 16:49:26.527629 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.quota [None req-59e0215e-1651-438b-8c6b-5c70c37b2241 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Getting quotas for user cc52fbd78dce4bbdada6305efb327264 and project b6154357c0184a0cb61602f2f110b1d7. Resources: {'cores', 'ram', 'instances'} {{(pid=118117) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 16:49:26.591623 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-59e0215e-1651-438b-8c6b-5c70c37b2241 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Going to run 1 instances... {{(pid=118117) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 16:49:26.593966 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-59e0215e-1651-438b-8c6b-5c70c37b2241 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] [instance: f4fff702-385b-4618-ab03-cdce331d1b63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='33b90821-80a4-4973-857c-1cbc2a40783b',volume_size=None,volume_type=None)] {{(pid=118117) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 16:49:26.751206 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-59e0215e-1651-438b-8c6b-5c70c37b2241 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.232816 Aug 01 16:49:26.751896 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 503/1019] 10.222.0.45 () {60 vars in 1147 bytes} [Mon Aug 1 16:49:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 1234 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 16:49:26.759624 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_cell1:SELECT=46 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:26.761013 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_cell0:SELECT=4 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:26.761654 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:26.765614 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-489a7610-d881-454f-85c5-cf467feada1d tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:49:26.766283 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-489a7610-d881-454f-85c5-cf467feada1d tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] [instance: f4fff702-385b-4618-ab03-cdce331d1b63] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:49:26.952349 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-489a7610-d881-454f-85c5-cf467feada1d tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc52fbd78dce4bbdada6305efb327264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6154357c0184a0cb61602f2f110b1d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:49:26.961842 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-489a7610-d881-454f-85c5-cf467feada1d tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] 10.222.0.45 "GET /compute/v2.1/servers/f4fff702-385b-4618-ab03-cdce331d1b63" status: 200 len: 1088 microversion: 2.1 time: 0.202717 Aug 01 16:49:26.962800 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 517/1020] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:49:26 2022] GET /compute/v2.1/servers/f4fff702-385b-4618-ab03-cdce331d1b63 => generated 1088 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:49:27.984889 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-4c744977-676a-46e6-bf1d-d72cd9b8240e tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:49:27.985455 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-4c744977-676a-46e6-bf1d-d72cd9b8240e tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] [instance: f4fff702-385b-4618-ab03-cdce331d1b63] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:49:27.992774 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-4c744977-676a-46e6-bf1d-d72cd9b8240e tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:49:27.993266 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-4c744977-676a-46e6-bf1d-d72cd9b8240e tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:49:27.994054 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-4c744977-676a-46e6-bf1d-d72cd9b8240e tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:49:27.994487 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-4c744977-676a-46e6-bf1d-d72cd9b8240e tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:49:28.063612 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-4c744977-676a-46e6-bf1d-d72cd9b8240e tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc52fbd78dce4bbdada6305efb327264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6154357c0184a0cb61602f2f110b1d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:49:28.072260 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-4c744977-676a-46e6-bf1d-d72cd9b8240e tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] 10.222.0.45 "GET /compute/v2.1/servers/f4fff702-385b-4618-ab03-cdce331d1b63" status: 200 len: 1204 microversion: 2.1 time: 0.091972 Aug 01 16:49:28.072849 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 504/1021] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:49:27 2022] GET /compute/v2.1/servers/f4fff702-385b-4618-ab03-cdce331d1b63 => generated 1204 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:49:29.093866 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-e747d23f-817a-49e4-bce9-5bbfc606eef4 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:49:29.094640 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-e747d23f-817a-49e4-bce9-5bbfc606eef4 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] [instance: f4fff702-385b-4618-ab03-cdce331d1b63] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:49:29.101495 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-e747d23f-817a-49e4-bce9-5bbfc606eef4 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:49:29.101936 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-e747d23f-817a-49e4-bce9-5bbfc606eef4 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:49:29.102705 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-e747d23f-817a-49e4-bce9-5bbfc606eef4 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:49:29.103131 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-e747d23f-817a-49e4-bce9-5bbfc606eef4 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:49:29.150902 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [req-3339d57c-b42a-49d1-ab69-a25555f8a29c req-b4c7706e-1fc9-4dc4-ae04-8c354759f320 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4fff702-385b-4618-ab03-cdce331d1b63", "tag": "c68d7d4a-fd0d-4348-9edf-31e94d52b533"}]} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:49:29.165358 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-3339d57c-b42a-49d1-ab69-a25555f8a29c req-b4c7706e-1fc9-4dc4-ae04-8c354759f320 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:49:29.166073 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-3339d57c-b42a-49d1-ab69-a25555f8a29c req-b4c7706e-1fc9-4dc4-ae04-8c354759f320 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:49:29.182598 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.compute.server_external_events [req-3339d57c-b42a-49d1-ab69-a25555f8a29c req-b4c7706e-1fc9-4dc4-ae04-8c354759f320 service nova] Creating event network-changed:c68d7d4a-fd0d-4348-9edf-31e94d52b533 for instance f4fff702-385b-4618-ab03-cdce331d1b63 on hv-cinder-85032 Aug 01 16:49:29.188113 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [req-3339d57c-b42a-49d1-ab69-a25555f8a29c req-b4c7706e-1fc9-4dc4-ae04-8c354759f320 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041217 Aug 01 16:49:29.188866 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 505/1022] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:49:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 16:49:29.263281 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-e747d23f-817a-49e4-bce9-5bbfc606eef4 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc52fbd78dce4bbdada6305efb327264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6154357c0184a0cb61602f2f110b1d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:49:29.271960 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-e747d23f-817a-49e4-bce9-5bbfc606eef4 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] 10.222.0.45 "GET /compute/v2.1/servers/f4fff702-385b-4618-ab03-cdce331d1b63" status: 200 len: 1260 microversion: 2.1 time: 0.181923 Aug 01 16:49:29.272648 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 518/1023] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:49:29 2022] GET /compute/v2.1/servers/f4fff702-385b-4618-ab03-cdce331d1b63 => generated 1260 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:49:30.296483 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-bcc9ab1c-e1fa-4cc4-a0e9-d098f534d657 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:49:30.297169 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-bcc9ab1c-e1fa-4cc4-a0e9-d098f534d657 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] [instance: f4fff702-385b-4618-ab03-cdce331d1b63] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:49:30.304116 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-bcc9ab1c-e1fa-4cc4-a0e9-d098f534d657 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:49:30.304547 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-bcc9ab1c-e1fa-4cc4-a0e9-d098f534d657 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:49:30.305327 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-bcc9ab1c-e1fa-4cc4-a0e9-d098f534d657 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:49:30.305753 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-bcc9ab1c-e1fa-4cc4-a0e9-d098f534d657 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:49:30.442239 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-bcc9ab1c-e1fa-4cc4-a0e9-d098f534d657 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc52fbd78dce4bbdada6305efb327264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6154357c0184a0cb61602f2f110b1d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:49:30.450644 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-bcc9ab1c-e1fa-4cc4-a0e9-d098f534d657 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] 10.222.0.45 "GET /compute/v2.1/servers/f4fff702-385b-4618-ab03-cdce331d1b63" status: 200 len: 1260 microversion: 2.1 time: 0.160011 Aug 01 16:49:30.451264 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 506/1024] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:49:30 2022] GET /compute/v2.1/servers/f4fff702-385b-4618-ab03-cdce331d1b63 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:49:31.472573 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-0f21da8e-068a-47e3-8d19-8c4b536305a5 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:49:31.473263 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-0f21da8e-068a-47e3-8d19-8c4b536305a5 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] [instance: f4fff702-385b-4618-ab03-cdce331d1b63] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:49:31.481056 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-0f21da8e-068a-47e3-8d19-8c4b536305a5 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:49:31.481504 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-0f21da8e-068a-47e3-8d19-8c4b536305a5 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:49:31.482273 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-0f21da8e-068a-47e3-8d19-8c4b536305a5 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:49:31.482702 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-0f21da8e-068a-47e3-8d19-8c4b536305a5 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:49:31.625183 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-0f21da8e-068a-47e3-8d19-8c4b536305a5 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc52fbd78dce4bbdada6305efb327264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6154357c0184a0cb61602f2f110b1d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:49:31.633188 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-0f21da8e-068a-47e3-8d19-8c4b536305a5 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] 10.222.0.45 "GET /compute/v2.1/servers/f4fff702-385b-4618-ab03-cdce331d1b63" status: 200 len: 1260 microversion: 2.1 time: 0.164602 Aug 01 16:49:31.633769 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 519/1025] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:49:31 2022] GET /compute/v2.1/servers/f4fff702-385b-4618-ab03-cdce331d1b63 => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:49:32.654809 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-0874f2cb-489a-4a33-849b-5dc444568427 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:49:32.655427 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-0874f2cb-489a-4a33-849b-5dc444568427 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] [instance: f4fff702-385b-4618-ab03-cdce331d1b63] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:49:32.662665 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-0874f2cb-489a-4a33-849b-5dc444568427 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:49:32.663360 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-0874f2cb-489a-4a33-849b-5dc444568427 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:49:32.664171 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-0874f2cb-489a-4a33-849b-5dc444568427 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:49:32.664587 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-0874f2cb-489a-4a33-849b-5dc444568427 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:49:32.801168 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-0874f2cb-489a-4a33-849b-5dc444568427 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc52fbd78dce4bbdada6305efb327264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6154357c0184a0cb61602f2f110b1d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:49:32.809871 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-0874f2cb-489a-4a33-849b-5dc444568427 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] 10.222.0.45 "GET /compute/v2.1/servers/f4fff702-385b-4618-ab03-cdce331d1b63" status: 200 len: 1260 microversion: 2.1 time: 0.159007 Aug 01 16:49:32.810608 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 507/1026] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:49:32 2022] GET /compute/v2.1/servers/f4fff702-385b-4618-ab03-cdce331d1b63 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:49:33.831267 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-b5f08b12-29eb-4370-9022-91207d89cd21 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:49:33.831963 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-b5f08b12-29eb-4370-9022-91207d89cd21 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] [instance: f4fff702-385b-4618-ab03-cdce331d1b63] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:49:33.839667 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-b5f08b12-29eb-4370-9022-91207d89cd21 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:49:33.840175 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-b5f08b12-29eb-4370-9022-91207d89cd21 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:49:33.840948 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-b5f08b12-29eb-4370-9022-91207d89cd21 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:49:33.841381 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-b5f08b12-29eb-4370-9022-91207d89cd21 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:49:33.985808 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-b5f08b12-29eb-4370-9022-91207d89cd21 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc52fbd78dce4bbdada6305efb327264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6154357c0184a0cb61602f2f110b1d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:49:33.994970 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-b5f08b12-29eb-4370-9022-91207d89cd21 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] 10.222.0.45 "GET /compute/v2.1/servers/f4fff702-385b-4618-ab03-cdce331d1b63" status: 200 len: 1260 microversion: 2.1 time: 0.167498 Aug 01 16:49:33.995577 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 520/1027] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:49:33 2022] GET /compute/v2.1/servers/f4fff702-385b-4618-ab03-cdce331d1b63 => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:49:35.016518 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-492df03b-c875-4842-9026-2907352b7339 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:49:35.017133 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-492df03b-c875-4842-9026-2907352b7339 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] [instance: f4fff702-385b-4618-ab03-cdce331d1b63] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:49:35.024495 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-492df03b-c875-4842-9026-2907352b7339 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:49:35.024938 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-492df03b-c875-4842-9026-2907352b7339 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:49:35.025710 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-492df03b-c875-4842-9026-2907352b7339 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:49:35.026141 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-492df03b-c875-4842-9026-2907352b7339 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:49:35.165224 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-492df03b-c875-4842-9026-2907352b7339 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc52fbd78dce4bbdada6305efb327264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6154357c0184a0cb61602f2f110b1d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:49:35.173434 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-492df03b-c875-4842-9026-2907352b7339 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] 10.222.0.45 "GET /compute/v2.1/servers/f4fff702-385b-4618-ab03-cdce331d1b63" status: 200 len: 1260 microversion: 2.1 time: 0.160827 Aug 01 16:49:35.174038 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 508/1028] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:49:35 2022] GET /compute/v2.1/servers/f4fff702-385b-4618-ab03-cdce331d1b63 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:49:36.196109 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-1b399059-f2c4-4dad-831a-44290a8ac440 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:49:36.196756 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-1b399059-f2c4-4dad-831a-44290a8ac440 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] [instance: f4fff702-385b-4618-ab03-cdce331d1b63] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:49:36.203771 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-1b399059-f2c4-4dad-831a-44290a8ac440 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:49:36.204237 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-1b399059-f2c4-4dad-831a-44290a8ac440 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:49:36.204997 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-1b399059-f2c4-4dad-831a-44290a8ac440 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:49:36.205412 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-1b399059-f2c4-4dad-831a-44290a8ac440 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:49:36.503161 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-1b399059-f2c4-4dad-831a-44290a8ac440 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc52fbd78dce4bbdada6305efb327264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6154357c0184a0cb61602f2f110b1d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:49:36.511812 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-1b399059-f2c4-4dad-831a-44290a8ac440 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] 10.222.0.45 "GET /compute/v2.1/servers/f4fff702-385b-4618-ab03-cdce331d1b63" status: 200 len: 1260 microversion: 2.1 time: 0.320279 Aug 01 16:49:36.512409 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 521/1029] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:49:36 2022] GET /compute/v2.1/servers/f4fff702-385b-4618-ab03-cdce331d1b63 => generated 1260 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:49:37.533540 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-9a838e17-c92f-438f-b9b5-cfa0e4c9a711 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:49:37.534177 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-9a838e17-c92f-438f-b9b5-cfa0e4c9a711 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] [instance: f4fff702-385b-4618-ab03-cdce331d1b63] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:49:37.536474 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_cell0:SELECT=2 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:37.537338 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_cell0:SELECT=6 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:37.543462 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-9a838e17-c92f-438f-b9b5-cfa0e4c9a711 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:49:37.544022 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-9a838e17-c92f-438f-b9b5-cfa0e4c9a711 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:49:37.544924 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-9a838e17-c92f-438f-b9b5-cfa0e4c9a711 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:49:37.545532 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-9a838e17-c92f-438f-b9b5-cfa0e4c9a711 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:49:37.692980 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-9a838e17-c92f-438f-b9b5-cfa0e4c9a711 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc52fbd78dce4bbdada6305efb327264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6154357c0184a0cb61602f2f110b1d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:49:37.701059 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-9a838e17-c92f-438f-b9b5-cfa0e4c9a711 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] 10.222.0.45 "GET /compute/v2.1/servers/f4fff702-385b-4618-ab03-cdce331d1b63" status: 200 len: 1260 microversion: 2.1 time: 0.171762 Aug 01 16:49:37.701639 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 509/1030] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:49:37 2022] GET /compute/v2.1/servers/f4fff702-385b-4618-ab03-cdce331d1b63 => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:49:38.723913 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-0a101993-a818-4c2e-bb25-794f05cb4d2c tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:49:38.724901 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-0a101993-a818-4c2e-bb25-794f05cb4d2c tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] [instance: f4fff702-385b-4618-ab03-cdce331d1b63] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:49:38.727908 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_cell0:SELECT=2 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:49:38.734461 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-0a101993-a818-4c2e-bb25-794f05cb4d2c tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:49:38.734894 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-0a101993-a818-4c2e-bb25-794f05cb4d2c tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:49:38.735672 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-0a101993-a818-4c2e-bb25-794f05cb4d2c tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:49:38.736123 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-0a101993-a818-4c2e-bb25-794f05cb4d2c tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:49:38.815602 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [req-802a1502-3f5d-4f99-a591-196cc5f343b1 req-29a3930c-2d2b-4e8f-92c1-f7518139e0f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4fff702-385b-4618-ab03-cdce331d1b63", "name": "network-vif-plugged", "status": "completed", "tag": "c68d7d4a-fd0d-4348-9edf-31e94d52b533"}]} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:49:38.830116 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-802a1502-3f5d-4f99-a591-196cc5f343b1 req-29a3930c-2d2b-4e8f-92c1-f7518139e0f7 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:49:38.830814 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-802a1502-3f5d-4f99-a591-196cc5f343b1 req-29a3930c-2d2b-4e8f-92c1-f7518139e0f7 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:49:38.847856 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.compute.server_external_events [req-802a1502-3f5d-4f99-a591-196cc5f343b1 req-29a3930c-2d2b-4e8f-92c1-f7518139e0f7 service nova] Creating event network-vif-plugged:c68d7d4a-fd0d-4348-9edf-31e94d52b533 for instance f4fff702-385b-4618-ab03-cdce331d1b63 on hv-cinder-85032 Aug 01 16:49:38.856809 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [req-802a1502-3f5d-4f99-a591-196cc5f343b1 req-29a3930c-2d2b-4e8f-92c1-f7518139e0f7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044538 Aug 01 16:49:38.857872 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 510/1031] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:49:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 16:49:38.880511 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-0a101993-a818-4c2e-bb25-794f05cb4d2c tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc52fbd78dce4bbdada6305efb327264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6154357c0184a0cb61602f2f110b1d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:49:38.890264 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-0a101993-a818-4c2e-bb25-794f05cb4d2c tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] 10.222.0.45 "GET /compute/v2.1/servers/f4fff702-385b-4618-ab03-cdce331d1b63" status: 200 len: 1260 microversion: 2.1 time: 0.171124 Aug 01 16:49:38.890834 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 522/1032] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:49:38 2022] GET /compute/v2.1/servers/f4fff702-385b-4618-ab03-cdce331d1b63 => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:49:39.913900 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-3c0e97cb-f7f3-4898-ba57-95713ee8a77c tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:49:39.914671 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-3c0e97cb-f7f3-4898-ba57-95713ee8a77c tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] [instance: f4fff702-385b-4618-ab03-cdce331d1b63] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:49:39.921614 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-3c0e97cb-f7f3-4898-ba57-95713ee8a77c tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:49:39.922104 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-3c0e97cb-f7f3-4898-ba57-95713ee8a77c tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:49:39.922873 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-3c0e97cb-f7f3-4898-ba57-95713ee8a77c tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:49:39.923310 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-3c0e97cb-f7f3-4898-ba57-95713ee8a77c tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:49:40.061648 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-3c0e97cb-f7f3-4898-ba57-95713ee8a77c tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc52fbd78dce4bbdada6305efb327264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6154357c0184a0cb61602f2f110b1d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:49:40.069847 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-3c0e97cb-f7f3-4898-ba57-95713ee8a77c tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] 10.222.0.45 "GET /compute/v2.1/servers/f4fff702-385b-4618-ab03-cdce331d1b63" status: 200 len: 1260 microversion: 2.1 time: 0.160619 Aug 01 16:49:40.070725 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 511/1033] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:49:39 2022] GET /compute/v2.1/servers/f4fff702-385b-4618-ab03-cdce331d1b63 => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:49:41.092368 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-0f65d7d0-0ff7-4a02-8adb-2b9369cf7450 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:49:41.093006 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-0f65d7d0-0ff7-4a02-8adb-2b9369cf7450 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] [instance: f4fff702-385b-4618-ab03-cdce331d1b63] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:49:41.099999 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-0f65d7d0-0ff7-4a02-8adb-2b9369cf7450 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:49:41.100447 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-0f65d7d0-0ff7-4a02-8adb-2b9369cf7450 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:49:41.101932 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-0f65d7d0-0ff7-4a02-8adb-2b9369cf7450 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:49:41.102405 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-0f65d7d0-0ff7-4a02-8adb-2b9369cf7450 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:49:41.236324 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-0f65d7d0-0ff7-4a02-8adb-2b9369cf7450 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc52fbd78dce4bbdada6305efb327264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6154357c0184a0cb61602f2f110b1d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:49:41.245204 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-0f65d7d0-0ff7-4a02-8adb-2b9369cf7450 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] 10.222.0.45 "GET /compute/v2.1/servers/f4fff702-385b-4618-ab03-cdce331d1b63" status: 200 len: 1444 microversion: 2.1 time: 0.156726 Aug 01 16:49:41.245780 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 523/1034] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:49:41 2022] GET /compute/v2.1/servers/f4fff702-385b-4618-ab03-cdce331d1b63 => generated 1444 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:49:41.265692 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-541fb789-ef85-49de-9b99-c41ddb2f5c7b tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:49:41.266385 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-541fb789-ef85-49de-9b99-c41ddb2f5c7b tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] [instance: f4fff702-385b-4618-ab03-cdce331d1b63] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:49:41.274299 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-541fb789-ef85-49de-9b99-c41ddb2f5c7b tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:49:41.274744 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-541fb789-ef85-49de-9b99-c41ddb2f5c7b tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:49:41.275527 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-541fb789-ef85-49de-9b99-c41ddb2f5c7b tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:49:41.275999 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-541fb789-ef85-49de-9b99-c41ddb2f5c7b tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:49:41.420578 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-541fb789-ef85-49de-9b99-c41ddb2f5c7b tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc52fbd78dce4bbdada6305efb327264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6154357c0184a0cb61602f2f110b1d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:49:41.428296 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-541fb789-ef85-49de-9b99-c41ddb2f5c7b tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] 10.222.0.45 "GET /compute/v2.1/servers/f4fff702-385b-4618-ab03-cdce331d1b63" status: 200 len: 1444 microversion: 2.1 time: 0.166486 Aug 01 16:49:41.428893 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 512/1035] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:49:41 2022] GET /compute/v2.1/servers/f4fff702-385b-4618-ab03-cdce331d1b63 => generated 1444 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:49:43.140281 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [req-6e3aea49-5b45-4a2a-a802-1767cdd3df02 req-f5db80f0-430e-4a07-9f28-9a7a85ac962f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4fff702-385b-4618-ab03-cdce331d1b63", "tag": "c68d7d4a-fd0d-4348-9edf-31e94d52b533"}]} {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:49:43.150727 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-6e3aea49-5b45-4a2a-a802-1767cdd3df02 req-f5db80f0-430e-4a07-9f28-9a7a85ac962f service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:49:43.151172 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-6e3aea49-5b45-4a2a-a802-1767cdd3df02 req-f5db80f0-430e-4a07-9f28-9a7a85ac962f service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:49:43.162834 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.compute.server_external_events [req-6e3aea49-5b45-4a2a-a802-1767cdd3df02 req-f5db80f0-430e-4a07-9f28-9a7a85ac962f service nova] Creating event network-changed:c68d7d4a-fd0d-4348-9edf-31e94d52b533 for instance f4fff702-385b-4618-ab03-cdce331d1b63 on hv-cinder-85032 Aug 01 16:49:43.168776 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [req-6e3aea49-5b45-4a2a-a802-1767cdd3df02 req-f5db80f0-430e-4a07-9f28-9a7a85ac962f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032344 Aug 01 16:49:43.169439 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 524/1036] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:49:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:50:31.065543 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_api:SELECT=18 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:31.066212 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-a1a06b27-697b-4f0a-9a39-e59b1ac5c3ca tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:50:31.066212 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-a1a06b27-697b-4f0a-9a39-e59b1ac5c3ca tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] [instance: 32799c1b-c5eb-4c06-af44-da8810a0cbcb] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:50:31.066746 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_cell1:SELECT=38 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:31.069540 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:31.070495 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_cell1:SELECT=48 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:50:31.077698 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-a1a06b27-697b-4f0a-9a39-e59b1ac5c3ca tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:50:31.078099 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-a1a06b27-697b-4f0a-9a39-e59b1ac5c3ca tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:50:31.078854 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-a1a06b27-697b-4f0a-9a39-e59b1ac5c3ca tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:50:31.079278 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-a1a06b27-697b-4f0a-9a39-e59b1ac5c3ca tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:50:31.108600 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-a1a06b27-697b-4f0a-9a39-e59b1ac5c3ca tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] [instance: 32799c1b-c5eb-4c06-af44-da8810a0cbcb] Going to try to terminate instance {{(pid=118117) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 16:50:31.135947 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [req-d230b568-8af9-4ea0-bdf3-9ea0c6e18e38 req-08477974-2464-4c63-ad91-4b767c3407ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32799c1b-c5eb-4c06-af44-da8810a0cbcb", "tag": "56ab5dda-abf7-466e-8d30-ed0735a4a925"}]} {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:50:31.146054 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-d230b568-8af9-4ea0-bdf3-9ea0c6e18e38 req-08477974-2464-4c63-ad91-4b767c3407ea service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:50:31.146500 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-d230b568-8af9-4ea0-bdf3-9ea0c6e18e38 req-08477974-2464-4c63-ad91-4b767c3407ea service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:50:31.158297 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.compute.server_external_events [req-d230b568-8af9-4ea0-bdf3-9ea0c6e18e38 req-08477974-2464-4c63-ad91-4b767c3407ea service nova] Creating event network-changed:56ab5dda-abf7-466e-8d30-ed0735a4a925 for instance 32799c1b-c5eb-4c06-af44-da8810a0cbcb on hv-cinder-85032 Aug 01 16:50:31.163649 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [req-d230b568-8af9-4ea0-bdf3-9ea0c6e18e38 req-08477974-2464-4c63-ad91-4b767c3407ea service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099514 Aug 01 16:50:31.164520 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 525/1037] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:50:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 16:50:31.214525 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-a1a06b27-697b-4f0a-9a39-e59b1ac5c3ca tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] 10.222.0.45 "DELETE /compute/v2.1/servers/32799c1b-c5eb-4c06-af44-da8810a0cbcb" status: 204 len: 0 microversion: 2.1 time: 0.152721 Aug 01 16:50:31.215323 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 513/1038] 10.222.0.45 () {58 vars in 1239 bytes} [Mon Aug 1 16:50:31 2022] DELETE /compute/v2.1/servers/32799c1b-c5eb-4c06-af44-da8810a0cbcb => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 16:50:31.226980 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-a2a75955-ea3e-459b-a78b-a5aba27efb28 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:50:31.228125 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-a2a75955-ea3e-459b-a78b-a5aba27efb28 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] [instance: 32799c1b-c5eb-4c06-af44-da8810a0cbcb] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:50:31.236906 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a2a75955-ea3e-459b-a78b-a5aba27efb28 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:50:31.237630 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a2a75955-ea3e-459b-a78b-a5aba27efb28 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:50:31.238538 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a2a75955-ea3e-459b-a78b-a5aba27efb28 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:50:31.238977 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-a2a75955-ea3e-459b-a78b-a5aba27efb28 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:50:31.380701 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-a2a75955-ea3e-459b-a78b-a5aba27efb28 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22cfd17a6f434deca7ef77253ae3ed2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86fcc5e23854dfba97058deac8211d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:50:31.387725 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-a2a75955-ea3e-459b-a78b-a5aba27efb28 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] 10.222.0.45 "GET /compute/v2.1/servers/32799c1b-c5eb-4c06-af44-da8810a0cbcb" status: 200 len: 1578 microversion: 2.1 time: 0.167873 Aug 01 16:50:31.388410 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 526/1039] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:50:31 2022] GET /compute/v2.1/servers/32799c1b-c5eb-4c06-af44-da8810a0cbcb => generated 1578 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 16:50:32.410908 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-c3a1eb14-f2dc-4cd7-86f6-48eb14a850ab tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:50:32.411875 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-c3a1eb14-f2dc-4cd7-86f6-48eb14a850ab tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] [instance: 32799c1b-c5eb-4c06-af44-da8810a0cbcb] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:50:32.419882 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-c3a1eb14-f2dc-4cd7-86f6-48eb14a850ab tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:50:32.420609 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-c3a1eb14-f2dc-4cd7-86f6-48eb14a850ab tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:50:32.421115 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-c3a1eb14-f2dc-4cd7-86f6-48eb14a850ab tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:50:32.421556 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-c3a1eb14-f2dc-4cd7-86f6-48eb14a850ab tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:50:32.574289 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-c3a1eb14-f2dc-4cd7-86f6-48eb14a850ab tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22cfd17a6f434deca7ef77253ae3ed2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86fcc5e23854dfba97058deac8211d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:50:32.583352 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-c3a1eb14-f2dc-4cd7-86f6-48eb14a850ab tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] 10.222.0.45 "GET /compute/v2.1/servers/32799c1b-c5eb-4c06-af44-da8810a0cbcb" status: 200 len: 1578 microversion: 2.1 time: 0.177043 Aug 01 16:50:32.584150 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 514/1040] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:50:32 2022] GET /compute/v2.1/servers/32799c1b-c5eb-4c06-af44-da8810a0cbcb => generated 1578 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:50:33.253404 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [req-abca2828-6ebf-4e29-b450-71a262bf827c req-632975dd-3a46-4db4-b3df-964c1b028d0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32799c1b-c5eb-4c06-af44-da8810a0cbcb", "name": "network-vif-deleted", "tag": "56ab5dda-abf7-466e-8d30-ed0735a4a925"}]} {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:50:33.263376 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-abca2828-6ebf-4e29-b450-71a262bf827c req-632975dd-3a46-4db4-b3df-964c1b028d0d service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:50:33.263933 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-abca2828-6ebf-4e29-b450-71a262bf827c req-632975dd-3a46-4db4-b3df-964c1b028d0d service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:50:33.275605 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.compute.server_external_events [req-abca2828-6ebf-4e29-b450-71a262bf827c req-632975dd-3a46-4db4-b3df-964c1b028d0d service nova] Creating event network-vif-deleted:56ab5dda-abf7-466e-8d30-ed0735a4a925 for instance 32799c1b-c5eb-4c06-af44-da8810a0cbcb on hv-cinder-85032 Aug 01 16:50:33.280737 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [req-abca2828-6ebf-4e29-b450-71a262bf827c req-632975dd-3a46-4db4-b3df-964c1b028d0d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094130 Aug 01 16:50:33.281377 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 527/1041] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:50:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:50:33.608412 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-592e62f4-79ec-4d2b-80fd-85cfa0737f8a tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:50:33.609354 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-592e62f4-79ec-4d2b-80fd-85cfa0737f8a tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] [instance: 32799c1b-c5eb-4c06-af44-da8810a0cbcb] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:50:33.618613 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-592e62f4-79ec-4d2b-80fd-85cfa0737f8a tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:50:33.619093 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-592e62f4-79ec-4d2b-80fd-85cfa0737f8a tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:50:33.619866 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-592e62f4-79ec-4d2b-80fd-85cfa0737f8a tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:50:33.620283 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-592e62f4-79ec-4d2b-80fd-85cfa0737f8a tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:50:33.653603 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-592e62f4-79ec-4d2b-80fd-85cfa0737f8a tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:50:33.654057 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-592e62f4-79ec-4d2b-80fd-85cfa0737f8a tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:50:33.654500 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.objects.instance [None req-592e62f4-79ec-4d2b-80fd-85cfa0737f8a tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lazy-loading 'fault' on Instance uuid 32799c1b-c5eb-4c06-af44-da8810a0cbcb {{(pid=118117) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 16:50:33.707478 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-592e62f4-79ec-4d2b-80fd-85cfa0737f8a tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22cfd17a6f434deca7ef77253ae3ed2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86fcc5e23854dfba97058deac8211d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:50:33.716365 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-592e62f4-79ec-4d2b-80fd-85cfa0737f8a tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] 10.222.0.45 "GET /compute/v2.1/servers/32799c1b-c5eb-4c06-af44-da8810a0cbcb" status: 200 len: 1230 microversion: 2.1 time: 0.114005 Aug 01 16:50:33.716937 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 515/1042] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:50:33 2022] GET /compute/v2.1/servers/32799c1b-c5eb-4c06-af44-da8810a0cbcb => generated 1230 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:50:34.738859 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-3cf6d0cb-baed-4c16-b42f-ae40f108303e tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:50:34.739799 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-3cf6d0cb-baed-4c16-b42f-ae40f108303e tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] [instance: 32799c1b-c5eb-4c06-af44-da8810a0cbcb] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:50:34.746924 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3cf6d0cb-baed-4c16-b42f-ae40f108303e tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:50:34.747364 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3cf6d0cb-baed-4c16-b42f-ae40f108303e tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:50:34.748157 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3cf6d0cb-baed-4c16-b42f-ae40f108303e tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:50:34.748581 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3cf6d0cb-baed-4c16-b42f-ae40f108303e tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:50:34.762904 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.wsgi [None req-3cf6d0cb-baed-4c16-b42f-ae40f108303e tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] HTTP exception thrown: Instance 32799c1b-c5eb-4c06-af44-da8810a0cbcb could not be found. Aug 01 16:50:34.764598 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-3cf6d0cb-baed-4c16-b42f-ae40f108303e tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Request method failure captured: Aug 01 16:50:34.764598 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: request: GET /compute/v2.1/servers/32799c1b-c5eb-4c06-af44-da8810a0cbcb HTTP/1.1 Aug 01 16:50:34.764598 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Accept: application/json Aug 01 16:50:34.764598 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Accept-Encoding: identity Aug 01 16:50:34.764598 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Connection: close Aug 01 16:50:34.764598 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Content-Length: 0 Aug 01 16:50:34.764598 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Content-Type: application/json Aug 01 16:50:34.764598 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Host: 10.222.0.45 Aug 01 16:50:34.764598 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Openstack-System-Scope: None Aug 01 16:50:34.764598 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: User-Agent: python-urllib3/1.26.10 Aug 01 16:50:34.764598 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Auth-Token: gAAAAABi6AKg8WmNwxCzvUjnoYA4FQHTxGwQvRdtB15M_AzfpDwZRSzODKfCo8aZ73Vjzj_qNkr77n7SZvW2FlrhpR3Gt34j8pB4XND9OfvN9vCqhBluiWD5-AMypzHSpaMRI3kZBLXVbAvlHpVHhGWg7H4X9yfBmfNdCySNXS6ys69JLd5AYAc Aug 01 16:50:34.764598 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Domain-Id: None Aug 01 16:50:34.764598 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Domain-Name: None Aug 01 16:50:34.764598 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Identity-Status: Confirmed Aug 01 16:50:34.764598 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Is-Admin-Project: True Aug 01 16:50:34.764598 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Domain-Id: default Aug 01 16:50:34.764598 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Domain-Name: Default Aug 01 16:50:34.764598 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Id: c86fcc5e23854dfba97058deac8211d0 Aug 01 16:50:34.764598 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Name: tempest-TestVolumeBootPattern-1374329435 Aug 01 16:50:34.764598 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Role: reader,member Aug 01 16:50:34.764598 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Roles: reader,member Aug 01 16:50:34.766402 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c86fcc5e23854dfba97058deac8211d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c86fcc5e23854dfba97058deac8211d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c86fcc5e23854dfba97058deac8211d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c86fcc5e23854dfba97058deac8211d0"}]}] Aug 01 16:50:34.766402 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant: tempest-TestVolumeBootPattern-1374329435 Aug 01 16:50:34.766402 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant-Id: c86fcc5e23854dfba97058deac8211d0 Aug 01 16:50:34.766402 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant-Name: tempest-TestVolumeBootPattern-1374329435 Aug 01 16:50:34.766402 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User: tempest-TestVolumeBootPattern-1374329435-project Aug 01 16:50:34.766402 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Domain-Id: default Aug 01 16:50:34.766402 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Domain-Name: Default Aug 01 16:50:34.766402 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Id: 22cfd17a6f434deca7ef77253ae3ed2f Aug 01 16:50:34.766402 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Name: tempest-TestVolumeBootPattern-1374329435-project Aug 01 16:50:34.766402 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: method: > Aug 01 16:50:34.766402 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: exception: Instance 32799c1b-c5eb-4c06-af44-da8810a0cbcb could not be found. Aug 01 16:50:34.766402 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: action_args: {'id': '32799c1b-c5eb-4c06-af44-da8810a0cbcb'} Aug 01 16:50:34.767393 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:50:34.767393 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:50:34.767393 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 16:50:34.767393 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 16:50:34.767393 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 16:50:34.767393 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 16:50:34.767393 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 16:50:34.767393 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 16:50:34.767393 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 16:50:34.767393 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 16:50:34.767393 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32799c1b-c5eb-4c06-af44-da8810a0cbcb could not be found. Aug 01 16:50:34.767393 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:50:34.767393 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:50:34.767393 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:50:34.767393 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:50:34.767393 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:50:34.767393 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:50:34.767393 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:50:34.767393 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:50:34.767393 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:50:34.769041 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:50:34.769041 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 16:50:34.769041 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 16:50:34.769041 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 16:50:34.769041 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 16:50:34.769041 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 16:50:34.769041 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:50:34.769041 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32799c1b-c5eb-4c06-af44-da8810a0cbcb could not be found. Aug 01 16:50:34.769041 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:50:34.769041 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:50:34.769041 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:50:34.769041 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:50:34.769041 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:50:34.769041 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:50:34.769041 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:50:34.769041 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:50:34.769041 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32799c1b-c5eb-4c06-af44-da8810a0cbcb could not be found. Aug 01 16:50:34.769041 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:50:34.770469 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-3cf6d0cb-baed-4c16-b42f-ae40f108303e tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Returning 404 to user: Instance 32799c1b-c5eb-4c06-af44-da8810a0cbcb could not be found. {{(pid=118118) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:50:34.770469 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-3cf6d0cb-baed-4c16-b42f-ae40f108303e tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] 10.222.0.45 "GET /compute/v2.1/servers/32799c1b-c5eb-4c06-af44-da8810a0cbcb" status: 404 len: 111 microversion: 2.1 time: 0.032020 Aug 01 16:50:34.770469 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 528/1043] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:50:34 2022] GET /compute/v2.1/servers/32799c1b-c5eb-4c06-af44-da8810a0cbcb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 16:50:38.158763 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-622d1256-1824-430a-94ae-b830a14eb6d9 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:50:38.159287 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-622d1256-1824-430a-94ae-b830a14eb6d9 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] [instance: 217725d8-74b1-41e3-b843-83904b818755] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:50:38.165006 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [req-ed657613-1a14-4f3b-a618-b400820075cf req-cfc1a9f7-c834-4dcb-8bbb-fc51756bcde7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "217725d8-74b1-41e3-b843-83904b818755", "tag": "36b424b9-b58b-402c-926b-0bb6a125aa3a"}]} {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:50:38.179074 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-ed657613-1a14-4f3b-a618-b400820075cf req-cfc1a9f7-c834-4dcb-8bbb-fc51756bcde7 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:50:38.179304 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-622d1256-1824-430a-94ae-b830a14eb6d9 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:50:38.179503 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-ed657613-1a14-4f3b-a618-b400820075cf req-cfc1a9f7-c834-4dcb-8bbb-fc51756bcde7 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:50:38.179671 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-622d1256-1824-430a-94ae-b830a14eb6d9 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:50:38.180443 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-622d1256-1824-430a-94ae-b830a14eb6d9 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:50:38.180877 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-622d1256-1824-430a-94ae-b830a14eb6d9 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:50:38.194242 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.compute.server_external_events [req-ed657613-1a14-4f3b-a618-b400820075cf req-cfc1a9f7-c834-4dcb-8bbb-fc51756bcde7 service nova] Creating event network-changed:36b424b9-b58b-402c-926b-0bb6a125aa3a for instance 217725d8-74b1-41e3-b843-83904b818755 on hv-cinder-85032 Aug 01 16:50:38.199534 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [req-ed657613-1a14-4f3b-a618-b400820075cf req-cfc1a9f7-c834-4dcb-8bbb-fc51756bcde7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038233 Aug 01 16:50:38.200512 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 529/1044] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:50:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:50:38.210254 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-622d1256-1824-430a-94ae-b830a14eb6d9 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] [instance: 217725d8-74b1-41e3-b843-83904b818755] Going to try to terminate instance {{(pid=118117) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 16:50:38.307090 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-622d1256-1824-430a-94ae-b830a14eb6d9 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] 10.222.0.45 "DELETE /compute/v2.1/servers/217725d8-74b1-41e3-b843-83904b818755" status: 204 len: 0 microversion: 2.1 time: 0.152196 Aug 01 16:50:38.307797 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 516/1045] 10.222.0.45 () {58 vars in 1239 bytes} [Mon Aug 1 16:50:38 2022] DELETE /compute/v2.1/servers/217725d8-74b1-41e3-b843-83904b818755 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 16:50:38.316686 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-9d51f779-107b-4e10-8ef6-fb61417614ab tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:50:38.317507 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-9d51f779-107b-4e10-8ef6-fb61417614ab tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] [instance: 217725d8-74b1-41e3-b843-83904b818755] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:50:38.324914 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-9d51f779-107b-4e10-8ef6-fb61417614ab tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:50:38.325670 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-9d51f779-107b-4e10-8ef6-fb61417614ab tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:50:38.326549 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-9d51f779-107b-4e10-8ef6-fb61417614ab tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:50:38.327075 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-9d51f779-107b-4e10-8ef6-fb61417614ab tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:50:38.475889 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-9d51f779-107b-4e10-8ef6-fb61417614ab tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22cfd17a6f434deca7ef77253ae3ed2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86fcc5e23854dfba97058deac8211d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:50:38.484642 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-9d51f779-107b-4e10-8ef6-fb61417614ab tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] 10.222.0.45 "GET /compute/v2.1/servers/217725d8-74b1-41e3-b843-83904b818755" status: 200 len: 1580 microversion: 2.1 time: 0.171803 Aug 01 16:50:38.485254 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 530/1046] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:50:38 2022] GET /compute/v2.1/servers/217725d8-74b1-41e3-b843-83904b818755 => generated 1580 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:50:39.507753 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-046289c5-eb87-4790-8543-2c77fe88ecb1 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:50:39.508630 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-046289c5-eb87-4790-8543-2c77fe88ecb1 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] [instance: 217725d8-74b1-41e3-b843-83904b818755] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:50:39.516102 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-046289c5-eb87-4790-8543-2c77fe88ecb1 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:50:39.516585 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-046289c5-eb87-4790-8543-2c77fe88ecb1 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:50:39.517370 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-046289c5-eb87-4790-8543-2c77fe88ecb1 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:50:39.517937 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-046289c5-eb87-4790-8543-2c77fe88ecb1 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:50:39.703977 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-046289c5-eb87-4790-8543-2c77fe88ecb1 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22cfd17a6f434deca7ef77253ae3ed2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86fcc5e23854dfba97058deac8211d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:50:39.712924 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-046289c5-eb87-4790-8543-2c77fe88ecb1 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] 10.222.0.45 "GET /compute/v2.1/servers/217725d8-74b1-41e3-b843-83904b818755" status: 200 len: 1580 microversion: 2.1 time: 0.209956 Aug 01 16:50:39.713511 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 517/1047] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:50:39 2022] GET /compute/v2.1/servers/217725d8-74b1-41e3-b843-83904b818755 => generated 1580 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:50:40.238197 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [req-dec26f24-791c-423c-a364-ddc0654c1825 req-903c0ae3-ad68-46bc-a684-08c8ea5479c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "217725d8-74b1-41e3-b843-83904b818755", "name": "network-vif-deleted", "tag": "36b424b9-b58b-402c-926b-0bb6a125aa3a"}]} {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:50:40.249137 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-dec26f24-791c-423c-a364-ddc0654c1825 req-903c0ae3-ad68-46bc-a684-08c8ea5479c2 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:50:40.249572 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-dec26f24-791c-423c-a364-ddc0654c1825 req-903c0ae3-ad68-46bc-a684-08c8ea5479c2 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:50:40.261740 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.compute.server_external_events [req-dec26f24-791c-423c-a364-ddc0654c1825 req-903c0ae3-ad68-46bc-a684-08c8ea5479c2 service nova] Creating event network-vif-deleted:36b424b9-b58b-402c-926b-0bb6a125aa3a for instance 217725d8-74b1-41e3-b843-83904b818755 on hv-cinder-85032 Aug 01 16:50:40.267027 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [req-dec26f24-791c-423c-a364-ddc0654c1825 req-903c0ae3-ad68-46bc-a684-08c8ea5479c2 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032669 Aug 01 16:50:40.267627 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 531/1048] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:50:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:50:40.738293 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-f8152b71-147d-419a-a9b3-ac6ba2bfe736 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:50:40.738920 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-f8152b71-147d-419a-a9b3-ac6ba2bfe736 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] [instance: 217725d8-74b1-41e3-b843-83904b818755] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:50:40.749743 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-f8152b71-147d-419a-a9b3-ac6ba2bfe736 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:50:40.750320 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-f8152b71-147d-419a-a9b3-ac6ba2bfe736 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:50:40.751478 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-f8152b71-147d-419a-a9b3-ac6ba2bfe736 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:50:40.752157 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-f8152b71-147d-419a-a9b3-ac6ba2bfe736 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:50:40.789167 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-f8152b71-147d-419a-a9b3-ac6ba2bfe736 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:50:40.789615 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-f8152b71-147d-419a-a9b3-ac6ba2bfe736 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:50:40.790058 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.objects.instance [None req-f8152b71-147d-419a-a9b3-ac6ba2bfe736 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lazy-loading 'fault' on Instance uuid 217725d8-74b1-41e3-b843-83904b818755 {{(pid=118117) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 16:50:40.842087 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-f8152b71-147d-419a-a9b3-ac6ba2bfe736 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22cfd17a6f434deca7ef77253ae3ed2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86fcc5e23854dfba97058deac8211d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:50:40.852716 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-f8152b71-147d-419a-a9b3-ac6ba2bfe736 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] 10.222.0.45 "GET /compute/v2.1/servers/217725d8-74b1-41e3-b843-83904b818755" status: 200 len: 1231 microversion: 2.1 time: 0.120461 Aug 01 16:50:40.853312 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 518/1049] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:50:40 2022] GET /compute/v2.1/servers/217725d8-74b1-41e3-b843-83904b818755 => generated 1231 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:50:41.879768 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-46729fc0-1fa7-4f57-a5c0-4148d2944b1f tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:50:41.880665 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-46729fc0-1fa7-4f57-a5c0-4148d2944b1f tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] [instance: 217725d8-74b1-41e3-b843-83904b818755] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:50:41.890987 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-46729fc0-1fa7-4f57-a5c0-4148d2944b1f tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:50:41.891552 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-46729fc0-1fa7-4f57-a5c0-4148d2944b1f tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:50:41.892758 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-46729fc0-1fa7-4f57-a5c0-4148d2944b1f tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:50:41.893394 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-46729fc0-1fa7-4f57-a5c0-4148d2944b1f tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:50:41.908603 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.wsgi [None req-46729fc0-1fa7-4f57-a5c0-4148d2944b1f tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] HTTP exception thrown: Instance 217725d8-74b1-41e3-b843-83904b818755 could not be found. Aug 01 16:50:41.910248 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-46729fc0-1fa7-4f57-a5c0-4148d2944b1f tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Request method failure captured: Aug 01 16:50:41.910248 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: request: GET /compute/v2.1/servers/217725d8-74b1-41e3-b843-83904b818755 HTTP/1.1 Aug 01 16:50:41.910248 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Accept: application/json Aug 01 16:50:41.910248 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Accept-Encoding: identity Aug 01 16:50:41.910248 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Connection: close Aug 01 16:50:41.910248 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Content-Length: 0 Aug 01 16:50:41.910248 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Content-Type: application/json Aug 01 16:50:41.910248 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Host: 10.222.0.45 Aug 01 16:50:41.910248 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Openstack-System-Scope: None Aug 01 16:50:41.910248 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: User-Agent: python-urllib3/1.26.10 Aug 01 16:50:41.910248 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Auth-Token: gAAAAABi6AKg8WmNwxCzvUjnoYA4FQHTxGwQvRdtB15M_AzfpDwZRSzODKfCo8aZ73Vjzj_qNkr77n7SZvW2FlrhpR3Gt34j8pB4XND9OfvN9vCqhBluiWD5-AMypzHSpaMRI3kZBLXVbAvlHpVHhGWg7H4X9yfBmfNdCySNXS6ys69JLd5AYAc Aug 01 16:50:41.910248 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Domain-Id: None Aug 01 16:50:41.910248 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Domain-Name: None Aug 01 16:50:41.910248 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Identity-Status: Confirmed Aug 01 16:50:41.910248 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Is-Admin-Project: True Aug 01 16:50:41.910248 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Domain-Id: default Aug 01 16:50:41.910248 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Domain-Name: Default Aug 01 16:50:41.910248 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Id: c86fcc5e23854dfba97058deac8211d0 Aug 01 16:50:41.910248 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Name: tempest-TestVolumeBootPattern-1374329435 Aug 01 16:50:41.910248 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Role: reader,member Aug 01 16:50:41.910248 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Roles: reader,member Aug 01 16:50:41.911901 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c86fcc5e23854dfba97058deac8211d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c86fcc5e23854dfba97058deac8211d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c86fcc5e23854dfba97058deac8211d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c86fcc5e23854dfba97058deac8211d0"}]}] Aug 01 16:50:41.911901 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant: tempest-TestVolumeBootPattern-1374329435 Aug 01 16:50:41.911901 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant-Id: c86fcc5e23854dfba97058deac8211d0 Aug 01 16:50:41.911901 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant-Name: tempest-TestVolumeBootPattern-1374329435 Aug 01 16:50:41.911901 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User: tempest-TestVolumeBootPattern-1374329435-project Aug 01 16:50:41.911901 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Domain-Id: default Aug 01 16:50:41.911901 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Domain-Name: Default Aug 01 16:50:41.911901 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Id: 22cfd17a6f434deca7ef77253ae3ed2f Aug 01 16:50:41.911901 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Name: tempest-TestVolumeBootPattern-1374329435-project Aug 01 16:50:41.911901 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: method: > Aug 01 16:50:41.911901 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: exception: Instance 217725d8-74b1-41e3-b843-83904b818755 could not be found. Aug 01 16:50:41.911901 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: action_args: {'id': '217725d8-74b1-41e3-b843-83904b818755'} Aug 01 16:50:41.914442 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:50:41.914442 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:50:41.914442 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 16:50:41.914442 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 16:50:41.914442 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 16:50:41.914442 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 16:50:41.914442 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 16:50:41.914442 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 16:50:41.914442 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 16:50:41.914442 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 16:50:41.914442 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 217725d8-74b1-41e3-b843-83904b818755 could not be found. Aug 01 16:50:41.914442 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:50:41.914442 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:50:41.914442 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:50:41.914442 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:50:41.914442 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:50:41.914442 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:50:41.914442 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:50:41.914442 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:50:41.914442 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:50:41.916135 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:50:41.916135 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 16:50:41.916135 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 16:50:41.916135 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 16:50:41.916135 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 16:50:41.916135 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 16:50:41.916135 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:50:41.916135 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 217725d8-74b1-41e3-b843-83904b818755 could not be found. Aug 01 16:50:41.916135 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:50:41.916135 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:50:41.916135 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:50:41.916135 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:50:41.916135 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:50:41.916135 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:50:41.916135 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:50:41.916135 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:50:41.916135 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 217725d8-74b1-41e3-b843-83904b818755 could not be found. Aug 01 16:50:41.916135 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:50:41.917994 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-46729fc0-1fa7-4f57-a5c0-4148d2944b1f tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Returning 404 to user: Instance 217725d8-74b1-41e3-b843-83904b818755 could not be found. {{(pid=118118) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:50:41.917994 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-46729fc0-1fa7-4f57-a5c0-4148d2944b1f tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] 10.222.0.45 "GET /compute/v2.1/servers/217725d8-74b1-41e3-b843-83904b818755" status: 404 len: 111 microversion: 2.1 time: 0.039739 Aug 01 16:50:41.917994 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 532/1050] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:50:41 2022] GET /compute/v2.1/servers/217725d8-74b1-41e3-b843-83904b818755 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 16:50:42.425783 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-99ae0894-98d6-43aa-bad8-9408ea6f78d9 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:50:42.426357 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-99ae0894-98d6-43aa-bad8-9408ea6f78d9 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] [instance: 45745fab-4299-4cef-a04a-619855e55336] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:50:42.435229 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-99ae0894-98d6-43aa-bad8-9408ea6f78d9 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:50:42.435725 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-99ae0894-98d6-43aa-bad8-9408ea6f78d9 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:50:42.436698 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-99ae0894-98d6-43aa-bad8-9408ea6f78d9 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:50:42.437171 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-99ae0894-98d6-43aa-bad8-9408ea6f78d9 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:50:42.453157 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.wsgi [None req-99ae0894-98d6-43aa-bad8-9408ea6f78d9 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] HTTP exception thrown: Instance 45745fab-4299-4cef-a04a-619855e55336 could not be found. Aug 01 16:50:42.454833 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-99ae0894-98d6-43aa-bad8-9408ea6f78d9 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Request method failure captured: Aug 01 16:50:42.454833 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: request: DELETE /compute/v2.1/servers/45745fab-4299-4cef-a04a-619855e55336 HTTP/1.1 Aug 01 16:50:42.454833 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Accept: application/json Aug 01 16:50:42.454833 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Accept-Encoding: identity Aug 01 16:50:42.454833 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Connection: close Aug 01 16:50:42.454833 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Content-Length: 0 Aug 01 16:50:42.454833 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Content-Type: application/json Aug 01 16:50:42.454833 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Host: 10.222.0.45 Aug 01 16:50:42.454833 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Openstack-System-Scope: None Aug 01 16:50:42.454833 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: User-Agent: python-urllib3/1.26.10 Aug 01 16:50:42.454833 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Auth-Token: gAAAAABi6AKg8WmNwxCzvUjnoYA4FQHTxGwQvRdtB15M_AzfpDwZRSzODKfCo8aZ73Vjzj_qNkr77n7SZvW2FlrhpR3Gt34j8pB4XND9OfvN9vCqhBluiWD5-AMypzHSpaMRI3kZBLXVbAvlHpVHhGWg7H4X9yfBmfNdCySNXS6ys69JLd5AYAc Aug 01 16:50:42.454833 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Domain-Id: None Aug 01 16:50:42.454833 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Domain-Name: None Aug 01 16:50:42.454833 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Identity-Status: Confirmed Aug 01 16:50:42.454833 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Is-Admin-Project: True Aug 01 16:50:42.454833 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Domain-Id: default Aug 01 16:50:42.454833 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Domain-Name: Default Aug 01 16:50:42.454833 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Id: c86fcc5e23854dfba97058deac8211d0 Aug 01 16:50:42.454833 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Project-Name: tempest-TestVolumeBootPattern-1374329435 Aug 01 16:50:42.454833 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Role: reader,member Aug 01 16:50:42.454833 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Roles: reader,member Aug 01 16:50:42.456519 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c86fcc5e23854dfba97058deac8211d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c86fcc5e23854dfba97058deac8211d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c86fcc5e23854dfba97058deac8211d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c86fcc5e23854dfba97058deac8211d0"}]}] Aug 01 16:50:42.456519 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Tenant: tempest-TestVolumeBootPattern-1374329435 Aug 01 16:50:42.456519 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Tenant-Id: c86fcc5e23854dfba97058deac8211d0 Aug 01 16:50:42.456519 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-Tenant-Name: tempest-TestVolumeBootPattern-1374329435 Aug 01 16:50:42.456519 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User: tempest-TestVolumeBootPattern-1374329435-project Aug 01 16:50:42.456519 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Domain-Id: default Aug 01 16:50:42.456519 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Domain-Name: Default Aug 01 16:50:42.456519 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Id: 22cfd17a6f434deca7ef77253ae3ed2f Aug 01 16:50:42.456519 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: X-User-Name: tempest-TestVolumeBootPattern-1374329435-project Aug 01 16:50:42.456519 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: method: > Aug 01 16:50:42.456519 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: exception: Instance 45745fab-4299-4cef-a04a-619855e55336 could not be found. Aug 01 16:50:42.456519 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: action_args: {'id': '45745fab-4299-4cef-a04a-619855e55336'} Aug 01 16:50:42.458256 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:50:42.458256 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:50:42.458256 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 16:50:42.458256 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 16:50:42.458256 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 16:50:42.458256 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 16:50:42.458256 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 16:50:42.458256 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 16:50:42.458256 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 16:50:42.458256 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 16:50:42.458256 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45745fab-4299-4cef-a04a-619855e55336 could not be found. Aug 01 16:50:42.458256 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:50:42.458256 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:50:42.458256 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:50:42.458256 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:50:42.458256 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:50:42.458256 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:50:42.458256 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:50:42.458256 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:50:42.458256 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:50:42.460402 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:50:42.460402 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 16:50:42.460402 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 16:50:42.460402 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 16:50:42.460402 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 16:50:42.460402 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 16:50:42.460402 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 16:50:42.460402 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 16:50:42.460402 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:50:42.460402 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45745fab-4299-4cef-a04a-619855e55336 could not be found. Aug 01 16:50:42.460402 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:50:42.460402 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:50:42.460402 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:50:42.460402 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:50:42.460402 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:50:42.460402 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:50:42.460402 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:50:42.460402 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:50:42.460402 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45745fab-4299-4cef-a04a-619855e55336 could not be found. Aug 01 16:50:42.460402 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR nova.api.openstack.wsgi Aug 01 16:50:42.462321 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-99ae0894-98d6-43aa-bad8-9408ea6f78d9 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Returning 404 to user: Instance 45745fab-4299-4cef-a04a-619855e55336 could not be found. {{(pid=118117) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:50:42.462321 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-99ae0894-98d6-43aa-bad8-9408ea6f78d9 tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] 10.222.0.45 "DELETE /compute/v2.1/servers/45745fab-4299-4cef-a04a-619855e55336" status: 404 len: 111 microversion: 2.1 time: 0.036257 Aug 01 16:50:42.462321 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 519/1051] 10.222.0.45 () {58 vars in 1239 bytes} [Mon Aug 1 16:50:42 2022] DELETE /compute/v2.1/servers/45745fab-4299-4cef-a04a-619855e55336 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 16:50:42.465958 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-3c9001ae-1d96-4928-845f-aaf3cf484b3d tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:50:42.466559 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-3c9001ae-1d96-4928-845f-aaf3cf484b3d tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] [instance: 45745fab-4299-4cef-a04a-619855e55336] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:50:42.472880 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3c9001ae-1d96-4928-845f-aaf3cf484b3d tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:50:42.473318 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3c9001ae-1d96-4928-845f-aaf3cf484b3d tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:50:42.474068 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3c9001ae-1d96-4928-845f-aaf3cf484b3d tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:50:42.474484 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3c9001ae-1d96-4928-845f-aaf3cf484b3d tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:50:42.488262 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.wsgi [None req-3c9001ae-1d96-4928-845f-aaf3cf484b3d tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] HTTP exception thrown: Instance 45745fab-4299-4cef-a04a-619855e55336 could not be found. Aug 01 16:50:42.489776 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-3c9001ae-1d96-4928-845f-aaf3cf484b3d tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Request method failure captured: Aug 01 16:50:42.489776 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: request: GET /compute/v2.1/servers/45745fab-4299-4cef-a04a-619855e55336 HTTP/1.1 Aug 01 16:50:42.489776 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Accept: application/json Aug 01 16:50:42.489776 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Accept-Encoding: identity Aug 01 16:50:42.489776 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Connection: close Aug 01 16:50:42.489776 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Content-Length: 0 Aug 01 16:50:42.489776 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Content-Type: application/json Aug 01 16:50:42.489776 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Host: 10.222.0.45 Aug 01 16:50:42.489776 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Openstack-System-Scope: None Aug 01 16:50:42.489776 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: User-Agent: python-urllib3/1.26.10 Aug 01 16:50:42.489776 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Auth-Token: gAAAAABi6AKg8WmNwxCzvUjnoYA4FQHTxGwQvRdtB15M_AzfpDwZRSzODKfCo8aZ73Vjzj_qNkr77n7SZvW2FlrhpR3Gt34j8pB4XND9OfvN9vCqhBluiWD5-AMypzHSpaMRI3kZBLXVbAvlHpVHhGWg7H4X9yfBmfNdCySNXS6ys69JLd5AYAc Aug 01 16:50:42.489776 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Domain-Id: None Aug 01 16:50:42.489776 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Domain-Name: None Aug 01 16:50:42.489776 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Identity-Status: Confirmed Aug 01 16:50:42.489776 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Is-Admin-Project: True Aug 01 16:50:42.489776 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Domain-Id: default Aug 01 16:50:42.489776 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Domain-Name: Default Aug 01 16:50:42.489776 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Id: c86fcc5e23854dfba97058deac8211d0 Aug 01 16:50:42.489776 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Name: tempest-TestVolumeBootPattern-1374329435 Aug 01 16:50:42.489776 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Role: reader,member Aug 01 16:50:42.489776 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Roles: reader,member Aug 01 16:50:42.491671 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c86fcc5e23854dfba97058deac8211d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c86fcc5e23854dfba97058deac8211d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c86fcc5e23854dfba97058deac8211d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c86fcc5e23854dfba97058deac8211d0"}]}] Aug 01 16:50:42.491671 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant: tempest-TestVolumeBootPattern-1374329435 Aug 01 16:50:42.491671 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant-Id: c86fcc5e23854dfba97058deac8211d0 Aug 01 16:50:42.491671 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant-Name: tempest-TestVolumeBootPattern-1374329435 Aug 01 16:50:42.491671 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User: tempest-TestVolumeBootPattern-1374329435-project Aug 01 16:50:42.491671 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Domain-Id: default Aug 01 16:50:42.491671 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Domain-Name: Default Aug 01 16:50:42.491671 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Id: 22cfd17a6f434deca7ef77253ae3ed2f Aug 01 16:50:42.491671 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Name: tempest-TestVolumeBootPattern-1374329435-project Aug 01 16:50:42.491671 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: method: > Aug 01 16:50:42.491671 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: exception: Instance 45745fab-4299-4cef-a04a-619855e55336 could not be found. Aug 01 16:50:42.491671 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: action_args: {'id': '45745fab-4299-4cef-a04a-619855e55336'} Aug 01 16:50:42.492737 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:50:42.492737 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:50:42.492737 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 16:50:42.492737 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 16:50:42.492737 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 16:50:42.492737 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 16:50:42.492737 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 16:50:42.492737 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 16:50:42.492737 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 16:50:42.492737 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 16:50:42.492737 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45745fab-4299-4cef-a04a-619855e55336 could not be found. Aug 01 16:50:42.492737 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:50:42.492737 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:50:42.492737 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:50:42.492737 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:50:42.492737 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:50:42.492737 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:50:42.492737 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:50:42.492737 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:50:42.492737 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:50:42.494260 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:50:42.494260 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 16:50:42.494260 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 16:50:42.494260 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 16:50:42.494260 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 16:50:42.494260 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 16:50:42.494260 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:50:42.494260 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45745fab-4299-4cef-a04a-619855e55336 could not be found. Aug 01 16:50:42.494260 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:50:42.494260 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:50:42.494260 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:50:42.494260 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:50:42.494260 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:50:42.494260 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:50:42.494260 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:50:42.494260 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:50:42.494260 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45745fab-4299-4cef-a04a-619855e55336 could not be found. Aug 01 16:50:42.494260 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:50:42.495618 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-3c9001ae-1d96-4928-845f-aaf3cf484b3d tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Returning 404 to user: Instance 45745fab-4299-4cef-a04a-619855e55336 could not be found. {{(pid=118118) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:50:42.495618 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-3c9001ae-1d96-4928-845f-aaf3cf484b3d tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] 10.222.0.45 "GET /compute/v2.1/servers/45745fab-4299-4cef-a04a-619855e55336" status: 404 len: 111 microversion: 2.1 time: 0.029150 Aug 01 16:50:42.495618 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 533/1052] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:50:42 2022] GET /compute/v2.1/servers/45745fab-4299-4cef-a04a-619855e55336 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 16:50:43.810387 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-13b6e29d-5a7d-4391-9ea2-2f3db47b110f tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] Calling method '.version_select at 0x7efd5ec39f70>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:50:43.815044 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: ERROR oslo.messaging._drivers.impl_rabbit [None req-13b6e29d-5a7d-4391-9ea2-2f3db47b110f tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] [5c387b62-2465-498e-b5f0-da7b1d1ec568] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 01 16:50:44.825201 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO oslo.messaging._drivers.impl_rabbit [None req-13b6e29d-5a7d-4391-9ea2-2f3db47b110f tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] [5c387b62-2465-498e-b5f0-da7b1d1ec568] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 40914. Aug 01 16:50:44.851372 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-13b6e29d-5a7d-4391-9ea2-2f3db47b110f tempest-TestVolumeBootPattern-1374329435 tempest-TestVolumeBootPattern-1374329435-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1173141553" status: 202 len: 0 microversion: 2.1 time: 1.044741 Aug 01 16:50:44.851992 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 520/1053] 10.222.0.45 () {58 vars in 1263 bytes} [Mon Aug 1 16:50:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1173141553 => generated 0 bytes in 1046 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 16:51:16.784315 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 16:51:16.784978 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Mon Aug 1 16:51:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 16:51:38.810610 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-d94db97e-6988-4d62-9841-d50c0b15b7b7 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:51:38.811372 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-d94db97e-6988-4d62-9841-d50c0b15b7b7 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] [instance: f4fff702-385b-4618-ab03-cdce331d1b63] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:51:38.813602 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_api:SELECT=18 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:38.814306 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_cell1:SELECT=26 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:38.821697 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-d94db97e-6988-4d62-9841-d50c0b15b7b7 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:51:38.822137 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-d94db97e-6988-4d62-9841-d50c0b15b7b7 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:51:38.822902 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-d94db97e-6988-4d62-9841-d50c0b15b7b7 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:51:38.823325 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-d94db97e-6988-4d62-9841-d50c0b15b7b7 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:51:38.847420 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.objects.instance [None req-d94db97e-6988-4d62-9841-d50c0b15b7b7 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lazy-loading 'flavor' on Instance uuid f4fff702-385b-4618-ab03-cdce331d1b63 {{(pid=118118) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 16:51:38.932349 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-d94db97e-6988-4d62-9841-d50c0b15b7b7 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] 10.222.0.45 "POST /compute/v2.1/servers/f4fff702-385b-4618-ab03-cdce331d1b63/action" status: 202 len: 0 microversion: 2.1 time: 0.125368 Aug 01 16:51:38.932886 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 534/1054] 10.222.0.45 () {60 vars in 1278 bytes} [Mon Aug 1 16:51:38 2022] POST /compute/v2.1/servers/f4fff702-385b-4618-ab03-cdce331d1b63/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 16:51:38.939446 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:38.940243 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:51:38.944562 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-67649750-1853-4f83-a082-042dca225407 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:51:38.945202 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-67649750-1853-4f83-a082-042dca225407 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] [instance: f4fff702-385b-4618-ab03-cdce331d1b63] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:51:38.952489 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-67649750-1853-4f83-a082-042dca225407 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:51:38.952935 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-67649750-1853-4f83-a082-042dca225407 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:51:38.953737 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-67649750-1853-4f83-a082-042dca225407 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:51:38.954765 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-67649750-1853-4f83-a082-042dca225407 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:51:39.096987 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-67649750-1853-4f83-a082-042dca225407 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc52fbd78dce4bbdada6305efb327264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6154357c0184a0cb61602f2f110b1d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:51:39.105796 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-67649750-1853-4f83-a082-042dca225407 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] 10.222.0.45 "GET /compute/v2.1/servers/f4fff702-385b-4618-ab03-cdce331d1b63" status: 200 len: 1569 microversion: 2.1 time: 0.168025 Aug 01 16:51:39.106401 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 521/1055] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:51:38 2022] GET /compute/v2.1/servers/f4fff702-385b-4618-ab03-cdce331d1b63 => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:51:40.130200 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-05be67a0-a63a-4868-88d7-ceac9572f17a tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:51:40.131587 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-05be67a0-a63a-4868-88d7-ceac9572f17a tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] [instance: f4fff702-385b-4618-ab03-cdce331d1b63] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:51:40.138221 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-05be67a0-a63a-4868-88d7-ceac9572f17a tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:51:40.138670 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-05be67a0-a63a-4868-88d7-ceac9572f17a tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:51:40.139563 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-05be67a0-a63a-4868-88d7-ceac9572f17a tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:51:40.139904 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-05be67a0-a63a-4868-88d7-ceac9572f17a tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:51:40.288929 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-05be67a0-a63a-4868-88d7-ceac9572f17a tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc52fbd78dce4bbdada6305efb327264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6154357c0184a0cb61602f2f110b1d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:51:40.296833 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-05be67a0-a63a-4868-88d7-ceac9572f17a tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] 10.222.0.45 "GET /compute/v2.1/servers/f4fff702-385b-4618-ab03-cdce331d1b63" status: 200 len: 1569 microversion: 2.1 time: 0.172324 Aug 01 16:51:40.297401 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 535/1056] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:51:40 2022] GET /compute/v2.1/servers/f4fff702-385b-4618-ab03-cdce331d1b63 => generated 1569 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:51:41.319588 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-8f81d252-0651-4b4a-b508-f6b06ed867bb tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:51:41.320267 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-8f81d252-0651-4b4a-b508-f6b06ed867bb tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] [instance: f4fff702-385b-4618-ab03-cdce331d1b63] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:51:41.327507 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-8f81d252-0651-4b4a-b508-f6b06ed867bb tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:51:41.328001 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-8f81d252-0651-4b4a-b508-f6b06ed867bb tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:51:41.328781 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-8f81d252-0651-4b4a-b508-f6b06ed867bb tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:51:41.329215 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-8f81d252-0651-4b4a-b508-f6b06ed867bb tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:51:41.476529 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-8f81d252-0651-4b4a-b508-f6b06ed867bb tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc52fbd78dce4bbdada6305efb327264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6154357c0184a0cb61602f2f110b1d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:51:41.484407 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-8f81d252-0651-4b4a-b508-f6b06ed867bb tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] 10.222.0.45 "GET /compute/v2.1/servers/f4fff702-385b-4618-ab03-cdce331d1b63" status: 200 len: 1569 microversion: 2.1 time: 0.169256 Aug 01 16:51:41.484985 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 522/1057] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:51:41 2022] GET /compute/v2.1/servers/f4fff702-385b-4618-ab03-cdce331d1b63 => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:51:42.506469 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-5d93b162-f641-4663-974a-74c90ebb223e tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:51:42.507108 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-5d93b162-f641-4663-974a-74c90ebb223e tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] [instance: f4fff702-385b-4618-ab03-cdce331d1b63] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:51:42.513971 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-5d93b162-f641-4663-974a-74c90ebb223e tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:51:42.514417 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-5d93b162-f641-4663-974a-74c90ebb223e tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:51:42.515194 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-5d93b162-f641-4663-974a-74c90ebb223e tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:51:42.515610 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-5d93b162-f641-4663-974a-74c90ebb223e tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:51:42.659656 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-5d93b162-f641-4663-974a-74c90ebb223e tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc52fbd78dce4bbdada6305efb327264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6154357c0184a0cb61602f2f110b1d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:51:42.667727 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-5d93b162-f641-4663-974a-74c90ebb223e tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] 10.222.0.45 "GET /compute/v2.1/servers/f4fff702-385b-4618-ab03-cdce331d1b63" status: 200 len: 1569 microversion: 2.1 time: 0.165958 Aug 01 16:51:42.668331 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 536/1058] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:51:42 2022] GET /compute/v2.1/servers/f4fff702-385b-4618-ab03-cdce331d1b63 => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:51:43.689561 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-68601c4c-25b0-406a-aadc-cca0482e9849 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:51:43.690199 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-68601c4c-25b0-406a-aadc-cca0482e9849 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] [instance: f4fff702-385b-4618-ab03-cdce331d1b63] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:51:43.697545 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-68601c4c-25b0-406a-aadc-cca0482e9849 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:51:43.697979 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-68601c4c-25b0-406a-aadc-cca0482e9849 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:51:43.698757 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-68601c4c-25b0-406a-aadc-cca0482e9849 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:51:43.699181 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-68601c4c-25b0-406a-aadc-cca0482e9849 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:51:43.852610 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-68601c4c-25b0-406a-aadc-cca0482e9849 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc52fbd78dce4bbdada6305efb327264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6154357c0184a0cb61602f2f110b1d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:51:43.860803 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-68601c4c-25b0-406a-aadc-cca0482e9849 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] 10.222.0.45 "GET /compute/v2.1/servers/f4fff702-385b-4618-ab03-cdce331d1b63" status: 200 len: 1569 microversion: 2.1 time: 0.175408 Aug 01 16:51:43.861364 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 523/1059] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:51:43 2022] GET /compute/v2.1/servers/f4fff702-385b-4618-ab03-cdce331d1b63 => generated 1569 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:51:44.885984 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-c0456874-a4cc-4da8-835e-b921f0259e80 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:51:44.886630 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-c0456874-a4cc-4da8-835e-b921f0259e80 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] [instance: f4fff702-385b-4618-ab03-cdce331d1b63] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:51:44.893937 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-c0456874-a4cc-4da8-835e-b921f0259e80 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:51:44.894431 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-c0456874-a4cc-4da8-835e-b921f0259e80 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:51:44.895247 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-c0456874-a4cc-4da8-835e-b921f0259e80 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:51:44.896092 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-c0456874-a4cc-4da8-835e-b921f0259e80 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:51:45.037960 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-c0456874-a4cc-4da8-835e-b921f0259e80 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc52fbd78dce4bbdada6305efb327264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6154357c0184a0cb61602f2f110b1d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:51:45.045757 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-c0456874-a4cc-4da8-835e-b921f0259e80 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] 10.222.0.45 "GET /compute/v2.1/servers/f4fff702-385b-4618-ab03-cdce331d1b63" status: 200 len: 1569 microversion: 2.1 time: 0.163966 Aug 01 16:51:45.046316 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 537/1060] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:51:44 2022] GET /compute/v2.1/servers/f4fff702-385b-4618-ab03-cdce331d1b63 => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:51:46.069274 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-9039e5eb-1788-40e4-a5da-dfcb7d97b74f tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:51:46.069855 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-9039e5eb-1788-40e4-a5da-dfcb7d97b74f tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] [instance: f4fff702-385b-4618-ab03-cdce331d1b63] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:51:46.076907 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-9039e5eb-1788-40e4-a5da-dfcb7d97b74f tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:51:46.077356 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-9039e5eb-1788-40e4-a5da-dfcb7d97b74f tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:51:46.078137 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-9039e5eb-1788-40e4-a5da-dfcb7d97b74f tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:51:46.078569 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-9039e5eb-1788-40e4-a5da-dfcb7d97b74f tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:51:46.217639 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-9039e5eb-1788-40e4-a5da-dfcb7d97b74f tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc52fbd78dce4bbdada6305efb327264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6154357c0184a0cb61602f2f110b1d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:51:46.225738 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-9039e5eb-1788-40e4-a5da-dfcb7d97b74f tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] 10.222.0.45 "GET /compute/v2.1/servers/f4fff702-385b-4618-ab03-cdce331d1b63" status: 200 len: 1569 microversion: 2.1 time: 0.162416 Aug 01 16:51:46.226312 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 524/1061] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:51:46 2022] GET /compute/v2.1/servers/f4fff702-385b-4618-ab03-cdce331d1b63 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:51:47.255649 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-d22f9a65-4162-4b63-9e40-c2900da222be tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:51:47.256324 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-d22f9a65-4162-4b63-9e40-c2900da222be tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] [instance: f4fff702-385b-4618-ab03-cdce331d1b63] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:51:47.263737 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-d22f9a65-4162-4b63-9e40-c2900da222be tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:51:47.264219 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-d22f9a65-4162-4b63-9e40-c2900da222be tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:51:47.264986 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-d22f9a65-4162-4b63-9e40-c2900da222be tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:51:47.265416 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-d22f9a65-4162-4b63-9e40-c2900da222be tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:51:47.404833 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-d22f9a65-4162-4b63-9e40-c2900da222be tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc52fbd78dce4bbdada6305efb327264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6154357c0184a0cb61602f2f110b1d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:51:47.412653 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-d22f9a65-4162-4b63-9e40-c2900da222be tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] 10.222.0.45 "GET /compute/v2.1/servers/f4fff702-385b-4618-ab03-cdce331d1b63" status: 200 len: 1569 microversion: 2.1 time: 0.161500 Aug 01 16:51:47.413181 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 538/1062] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:51:47 2022] GET /compute/v2.1/servers/f4fff702-385b-4618-ab03-cdce331d1b63 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:51:48.442111 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-65ca8886-deb9-420f-b5bd-cea1d1505234 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:51:48.442783 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-65ca8886-deb9-420f-b5bd-cea1d1505234 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] [instance: f4fff702-385b-4618-ab03-cdce331d1b63] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:51:48.450194 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-65ca8886-deb9-420f-b5bd-cea1d1505234 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:51:48.450632 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-65ca8886-deb9-420f-b5bd-cea1d1505234 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:51:48.451395 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-65ca8886-deb9-420f-b5bd-cea1d1505234 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:51:48.451853 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-65ca8886-deb9-420f-b5bd-cea1d1505234 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:51:48.595450 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-65ca8886-deb9-420f-b5bd-cea1d1505234 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc52fbd78dce4bbdada6305efb327264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6154357c0184a0cb61602f2f110b1d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:51:48.603706 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-65ca8886-deb9-420f-b5bd-cea1d1505234 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] 10.222.0.45 "GET /compute/v2.1/servers/f4fff702-385b-4618-ab03-cdce331d1b63" status: 200 len: 1569 microversion: 2.1 time: 0.165500 Aug 01 16:51:48.604299 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 525/1063] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:51:48 2022] GET /compute/v2.1/servers/f4fff702-385b-4618-ab03-cdce331d1b63 => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:51:49.625384 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-3ae2c821-fbbe-41d6-8c5c-8d8caa477956 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:51:49.626016 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-3ae2c821-fbbe-41d6-8c5c-8d8caa477956 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] [instance: f4fff702-385b-4618-ab03-cdce331d1b63] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:51:49.633023 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3ae2c821-fbbe-41d6-8c5c-8d8caa477956 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:51:49.633467 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3ae2c821-fbbe-41d6-8c5c-8d8caa477956 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:51:49.634235 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3ae2c821-fbbe-41d6-8c5c-8d8caa477956 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:51:49.634663 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3ae2c821-fbbe-41d6-8c5c-8d8caa477956 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:51:49.774622 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-3ae2c821-fbbe-41d6-8c5c-8d8caa477956 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc52fbd78dce4bbdada6305efb327264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6154357c0184a0cb61602f2f110b1d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:51:49.782791 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-3ae2c821-fbbe-41d6-8c5c-8d8caa477956 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] 10.222.0.45 "GET /compute/v2.1/servers/f4fff702-385b-4618-ab03-cdce331d1b63" status: 200 len: 1569 microversion: 2.1 time: 0.161593 Aug 01 16:51:49.783354 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 539/1064] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:51:49 2022] GET /compute/v2.1/servers/f4fff702-385b-4618-ab03-cdce331d1b63 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:51:50.806906 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-8d405f18-8e10-4163-bb4d-f6fdbfc781b1 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:51:50.807858 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-8d405f18-8e10-4163-bb4d-f6fdbfc781b1 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] [instance: f4fff702-385b-4618-ab03-cdce331d1b63] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:51:50.817910 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-8d405f18-8e10-4163-bb4d-f6fdbfc781b1 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:51:50.818357 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-8d405f18-8e10-4163-bb4d-f6fdbfc781b1 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:51:50.819125 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-8d405f18-8e10-4163-bb4d-f6fdbfc781b1 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:51:50.819556 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-8d405f18-8e10-4163-bb4d-f6fdbfc781b1 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:51:50.978478 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-8d405f18-8e10-4163-bb4d-f6fdbfc781b1 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc52fbd78dce4bbdada6305efb327264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6154357c0184a0cb61602f2f110b1d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:51:50.986720 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-8d405f18-8e10-4163-bb4d-f6fdbfc781b1 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] 10.222.0.45 "GET /compute/v2.1/servers/f4fff702-385b-4618-ab03-cdce331d1b63" status: 200 len: 1569 microversion: 2.1 time: 0.185697 Aug 01 16:51:50.987289 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 526/1065] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:51:50 2022] GET /compute/v2.1/servers/f4fff702-385b-4618-ab03-cdce331d1b63 => generated 1569 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:51:52.017816 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-2c7fc234-bbec-46f3-8967-84eb44c58494 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:51:52.018626 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-2c7fc234-bbec-46f3-8967-84eb44c58494 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] [instance: f4fff702-385b-4618-ab03-cdce331d1b63] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:51:52.029409 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-2c7fc234-bbec-46f3-8967-84eb44c58494 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:51:52.030097 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-2c7fc234-bbec-46f3-8967-84eb44c58494 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:51:52.031332 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-2c7fc234-bbec-46f3-8967-84eb44c58494 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:51:52.032108 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-2c7fc234-bbec-46f3-8967-84eb44c58494 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:51:52.193530 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-2c7fc234-bbec-46f3-8967-84eb44c58494 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc52fbd78dce4bbdada6305efb327264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6154357c0184a0cb61602f2f110b1d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:51:52.201736 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-2c7fc234-bbec-46f3-8967-84eb44c58494 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] 10.222.0.45 "GET /compute/v2.1/servers/f4fff702-385b-4618-ab03-cdce331d1b63" status: 200 len: 1510 microversion: 2.1 time: 0.189631 Aug 01 16:51:52.202321 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 540/1066] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:51:52 2022] GET /compute/v2.1/servers/f4fff702-385b-4618-ab03-cdce331d1b63 => generated 1510 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:51:52.228979 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-3f691d9a-4d66-4152-9294-2ab468f02316 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:51:52.229589 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-3f691d9a-4d66-4152-9294-2ab468f02316 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] [instance: f4fff702-385b-4618-ab03-cdce331d1b63] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:51:52.236409 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-3f691d9a-4d66-4152-9294-2ab468f02316 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:51:52.237027 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-3f691d9a-4d66-4152-9294-2ab468f02316 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:51:52.237797 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-3f691d9a-4d66-4152-9294-2ab468f02316 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:51:52.238224 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-3f691d9a-4d66-4152-9294-2ab468f02316 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:51:52.268075 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-3f691d9a-4d66-4152-9294-2ab468f02316 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] [instance: f4fff702-385b-4618-ab03-cdce331d1b63] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118117) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 01 16:51:52.344152 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-3f691d9a-4d66-4152-9294-2ab468f02316 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] 10.222.0.45 "POST /compute/v2.1/servers/f4fff702-385b-4618-ab03-cdce331d1b63/action" status: 202 len: 0 microversion: 2.1 time: 0.119128 Aug 01 16:51:52.345044 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 527/1067] 10.222.0.45 () {60 vars in 1278 bytes} [Mon Aug 1 16:51:52 2022] POST /compute/v2.1/servers/f4fff702-385b-4618-ab03-cdce331d1b63/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 16:51:52.354383 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-7f022bee-0d9a-488a-b3eb-35a31d23c6c1 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:51:52.355452 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-7f022bee-0d9a-488a-b3eb-35a31d23c6c1 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] [instance: f4fff702-385b-4618-ab03-cdce331d1b63] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:51:52.361342 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-7f022bee-0d9a-488a-b3eb-35a31d23c6c1 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:51:52.361778 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-7f022bee-0d9a-488a-b3eb-35a31d23c6c1 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:51:52.362884 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-7f022bee-0d9a-488a-b3eb-35a31d23c6c1 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:51:52.363404 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-7f022bee-0d9a-488a-b3eb-35a31d23c6c1 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:51:52.505049 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-7f022bee-0d9a-488a-b3eb-35a31d23c6c1 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc52fbd78dce4bbdada6305efb327264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6154357c0184a0cb61602f2f110b1d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:51:52.511944 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-7f022bee-0d9a-488a-b3eb-35a31d23c6c1 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] 10.222.0.45 "GET /compute/v2.1/servers/f4fff702-385b-4618-ab03-cdce331d1b63" status: 200 len: 1518 microversion: 2.1 time: 0.161999 Aug 01 16:51:52.512531 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 541/1068] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:51:52 2022] GET /compute/v2.1/servers/f4fff702-385b-4618-ab03-cdce331d1b63 => generated 1518 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:51:53.538154 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-af3c6b9c-2545-40be-ba23-6671ca240ae5 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:51:53.538754 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-af3c6b9c-2545-40be-ba23-6671ca240ae5 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] [instance: f4fff702-385b-4618-ab03-cdce331d1b63] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:51:53.545229 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-af3c6b9c-2545-40be-ba23-6671ca240ae5 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:51:53.545691 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-af3c6b9c-2545-40be-ba23-6671ca240ae5 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:51:53.546459 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-af3c6b9c-2545-40be-ba23-6671ca240ae5 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:51:53.546900 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-af3c6b9c-2545-40be-ba23-6671ca240ae5 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:51:53.696201 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-af3c6b9c-2545-40be-ba23-6671ca240ae5 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc52fbd78dce4bbdada6305efb327264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6154357c0184a0cb61602f2f110b1d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:51:53.703951 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-af3c6b9c-2545-40be-ba23-6671ca240ae5 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] 10.222.0.45 "GET /compute/v2.1/servers/f4fff702-385b-4618-ab03-cdce331d1b63" status: 200 len: 1520 microversion: 2.1 time: 0.172098 Aug 01 16:51:53.704546 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 528/1069] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:51:53 2022] GET /compute/v2.1/servers/f4fff702-385b-4618-ab03-cdce331d1b63 => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:51:54.727821 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-56d26e18-ea27-4dad-945f-ad24201f7de0 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:51:54.728426 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-56d26e18-ea27-4dad-945f-ad24201f7de0 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] [instance: f4fff702-385b-4618-ab03-cdce331d1b63] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:51:54.737944 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-56d26e18-ea27-4dad-945f-ad24201f7de0 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:51:54.738559 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-56d26e18-ea27-4dad-945f-ad24201f7de0 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:51:54.739845 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-56d26e18-ea27-4dad-945f-ad24201f7de0 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:51:54.740283 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-56d26e18-ea27-4dad-945f-ad24201f7de0 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:51:54.879816 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-56d26e18-ea27-4dad-945f-ad24201f7de0 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc52fbd78dce4bbdada6305efb327264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6154357c0184a0cb61602f2f110b1d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:51:54.888698 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-56d26e18-ea27-4dad-945f-ad24201f7de0 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] 10.222.0.45 "GET /compute/v2.1/servers/f4fff702-385b-4618-ab03-cdce331d1b63" status: 200 len: 1576 microversion: 2.1 time: 0.166833 Aug 01 16:51:54.889294 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 542/1070] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:51:54 2022] GET /compute/v2.1/servers/f4fff702-385b-4618-ab03-cdce331d1b63 => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:51:55.515206 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [req-9389fe2a-0cad-494e-815e-1655bde67cb6 req-a5eeccbc-fece-4b1f-8ecd-f66bca173892 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4fff702-385b-4618-ab03-cdce331d1b63", "name": "network-vif-unplugged", "status": "completed", "tag": "c68d7d4a-fd0d-4348-9edf-31e94d52b533"}]} {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:51:55.526627 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-9389fe2a-0cad-494e-815e-1655bde67cb6 req-a5eeccbc-fece-4b1f-8ecd-f66bca173892 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:51:55.527042 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [req-9389fe2a-0cad-494e-815e-1655bde67cb6 req-a5eeccbc-fece-4b1f-8ecd-f66bca173892 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:51:55.538846 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.compute.server_external_events [req-9389fe2a-0cad-494e-815e-1655bde67cb6 req-a5eeccbc-fece-4b1f-8ecd-f66bca173892 service nova] Creating event network-vif-unplugged:c68d7d4a-fd0d-4348-9edf-31e94d52b533 for instance f4fff702-385b-4618-ab03-cdce331d1b63 on hv-cinder-85032 Aug 01 16:51:55.544013 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [req-9389fe2a-0cad-494e-815e-1655bde67cb6 req-a5eeccbc-fece-4b1f-8ecd-f66bca173892 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.098908 Aug 01 16:51:55.544595 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 529/1071] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:51:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:51:55.913120 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-e9ce7437-9eb2-4f46-b737-91e5f1aebafe tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:51:55.913711 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-e9ce7437-9eb2-4f46-b737-91e5f1aebafe tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] [instance: f4fff702-385b-4618-ab03-cdce331d1b63] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:51:55.921271 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-e9ce7437-9eb2-4f46-b737-91e5f1aebafe tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:51:55.921716 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-e9ce7437-9eb2-4f46-b737-91e5f1aebafe tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:51:55.922474 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-e9ce7437-9eb2-4f46-b737-91e5f1aebafe tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:51:55.922905 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-e9ce7437-9eb2-4f46-b737-91e5f1aebafe tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:51:56.063164 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-e9ce7437-9eb2-4f46-b737-91e5f1aebafe tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc52fbd78dce4bbdada6305efb327264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6154357c0184a0cb61602f2f110b1d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:51:56.071717 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-e9ce7437-9eb2-4f46-b737-91e5f1aebafe tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] 10.222.0.45 "GET /compute/v2.1/servers/f4fff702-385b-4618-ab03-cdce331d1b63" status: 200 len: 1576 microversion: 2.1 time: 0.162647 Aug 01 16:51:56.072297 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 543/1072] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:51:55 2022] GET /compute/v2.1/servers/f4fff702-385b-4618-ab03-cdce331d1b63 => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:51:57.101605 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-fe782a09-c59c-4ff6-a985-c324840e6c2e tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:51:57.102318 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-fe782a09-c59c-4ff6-a985-c324840e6c2e tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] [instance: f4fff702-385b-4618-ab03-cdce331d1b63] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:51:57.111821 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-fe782a09-c59c-4ff6-a985-c324840e6c2e tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:51:57.112326 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-fe782a09-c59c-4ff6-a985-c324840e6c2e tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:51:57.113371 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-fe782a09-c59c-4ff6-a985-c324840e6c2e tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:51:57.113944 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-fe782a09-c59c-4ff6-a985-c324840e6c2e tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:51:57.276602 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-fe782a09-c59c-4ff6-a985-c324840e6c2e tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc52fbd78dce4bbdada6305efb327264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6154357c0184a0cb61602f2f110b1d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:51:57.290056 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-fe782a09-c59c-4ff6-a985-c324840e6c2e tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] 10.222.0.45 "GET /compute/v2.1/servers/f4fff702-385b-4618-ab03-cdce331d1b63" status: 200 len: 1576 microversion: 2.1 time: 0.194892 Aug 01 16:51:57.290265 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 530/1073] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:51:57 2022] GET /compute/v2.1/servers/f4fff702-385b-4618-ab03-cdce331d1b63 => generated 1576 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:51:58.277258 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 16:51:58.278032 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Mon Aug 1 16:51:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 16:51:58.314683 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-3ad3a85b-0042-4a83-b18e-6c6d0658d9ae tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:51:58.315280 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-3ad3a85b-0042-4a83-b18e-6c6d0658d9ae tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] [instance: f4fff702-385b-4618-ab03-cdce331d1b63] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:51:58.322624 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3ad3a85b-0042-4a83-b18e-6c6d0658d9ae tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:51:58.323062 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3ad3a85b-0042-4a83-b18e-6c6d0658d9ae tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:51:58.323817 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3ad3a85b-0042-4a83-b18e-6c6d0658d9ae tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:51:58.324270 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-3ad3a85b-0042-4a83-b18e-6c6d0658d9ae tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:51:58.473125 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-3ad3a85b-0042-4a83-b18e-6c6d0658d9ae tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc52fbd78dce4bbdada6305efb327264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6154357c0184a0cb61602f2f110b1d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:51:58.482055 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-3ad3a85b-0042-4a83-b18e-6c6d0658d9ae tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] 10.222.0.45 "GET /compute/v2.1/servers/f4fff702-385b-4618-ab03-cdce331d1b63" status: 200 len: 1576 microversion: 2.1 time: 0.171173 Aug 01 16:51:58.482614 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 544/1074] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:51:58 2022] GET /compute/v2.1/servers/f4fff702-385b-4618-ab03-cdce331d1b63 => generated 1576 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:51:59.506734 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-b38cdf62-fa21-41eb-bce7-658f36afc6b5 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:51:59.507418 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-b38cdf62-fa21-41eb-bce7-658f36afc6b5 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] [instance: f4fff702-385b-4618-ab03-cdce331d1b63] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:51:59.516680 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-b38cdf62-fa21-41eb-bce7-658f36afc6b5 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:51:59.517228 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-b38cdf62-fa21-41eb-bce7-658f36afc6b5 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:51:59.518310 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-b38cdf62-fa21-41eb-bce7-658f36afc6b5 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:51:59.518855 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-b38cdf62-fa21-41eb-bce7-658f36afc6b5 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:51:59.666427 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-b38cdf62-fa21-41eb-bce7-658f36afc6b5 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc52fbd78dce4bbdada6305efb327264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6154357c0184a0cb61602f2f110b1d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:51:59.674461 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-b38cdf62-fa21-41eb-bce7-658f36afc6b5 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] 10.222.0.45 "GET /compute/v2.1/servers/f4fff702-385b-4618-ab03-cdce331d1b63" status: 200 len: 1576 microversion: 2.1 time: 0.172940 Aug 01 16:51:59.675039 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 531/1075] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:51:59 2022] GET /compute/v2.1/servers/f4fff702-385b-4618-ab03-cdce331d1b63 => generated 1576 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:52:00.697077 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-acc54788-d8f5-4ac5-86ba-f0590ab5a32b tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:52:00.697723 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-acc54788-d8f5-4ac5-86ba-f0590ab5a32b tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] [instance: f4fff702-385b-4618-ab03-cdce331d1b63] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:52:00.704604 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-acc54788-d8f5-4ac5-86ba-f0590ab5a32b tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:52:00.705051 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-acc54788-d8f5-4ac5-86ba-f0590ab5a32b tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:52:00.706558 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-acc54788-d8f5-4ac5-86ba-f0590ab5a32b tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:52:00.707004 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-acc54788-d8f5-4ac5-86ba-f0590ab5a32b tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:52:00.843726 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-acc54788-d8f5-4ac5-86ba-f0590ab5a32b tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc52fbd78dce4bbdada6305efb327264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6154357c0184a0cb61602f2f110b1d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:52:00.854172 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-acc54788-d8f5-4ac5-86ba-f0590ab5a32b tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] 10.222.0.45 "GET /compute/v2.1/servers/f4fff702-385b-4618-ab03-cdce331d1b63" status: 200 len: 1576 microversion: 2.1 time: 0.161298 Aug 01 16:52:00.854718 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 545/1076] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:52:00 2022] GET /compute/v2.1/servers/f4fff702-385b-4618-ab03-cdce331d1b63 => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:52:01.877521 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-45215180-24b9-489f-8779-547e21a87f9c tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:52:01.878084 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-45215180-24b9-489f-8779-547e21a87f9c tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] [instance: f4fff702-385b-4618-ab03-cdce331d1b63] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:52:01.885893 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-45215180-24b9-489f-8779-547e21a87f9c tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:52:01.886337 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-45215180-24b9-489f-8779-547e21a87f9c tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:52:01.887107 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-45215180-24b9-489f-8779-547e21a87f9c tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:52:01.887541 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-45215180-24b9-489f-8779-547e21a87f9c tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:52:02.065448 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-45215180-24b9-489f-8779-547e21a87f9c tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc52fbd78dce4bbdada6305efb327264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6154357c0184a0cb61602f2f110b1d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:52:02.073810 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-45215180-24b9-489f-8779-547e21a87f9c tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] 10.222.0.45 "GET /compute/v2.1/servers/f4fff702-385b-4618-ab03-cdce331d1b63" status: 200 len: 1563 microversion: 2.1 time: 0.200154 Aug 01 16:52:02.074391 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 532/1077] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:52:01 2022] GET /compute/v2.1/servers/f4fff702-385b-4618-ab03-cdce331d1b63 => generated 1563 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:52:05.547261 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [req-bd582a2f-da8a-4588-8e40-293c63165a0d req-818a0c7b-71ab-4b4e-b2c9-74adf4584e10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4fff702-385b-4618-ab03-cdce331d1b63", "name": "network-vif-plugged", "status": "completed", "tag": "c68d7d4a-fd0d-4348-9edf-31e94d52b533"}]} {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:52:05.559926 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-bd582a2f-da8a-4588-8e40-293c63165a0d req-818a0c7b-71ab-4b4e-b2c9-74adf4584e10 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:52:05.560371 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-bd582a2f-da8a-4588-8e40-293c63165a0d req-818a0c7b-71ab-4b4e-b2c9-74adf4584e10 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:52:05.573293 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.compute.server_external_events [req-bd582a2f-da8a-4588-8e40-293c63165a0d req-818a0c7b-71ab-4b4e-b2c9-74adf4584e10 service nova] Creating event network-vif-plugged:c68d7d4a-fd0d-4348-9edf-31e94d52b533 for instance f4fff702-385b-4618-ab03-cdce331d1b63 on hv-cinder-85032 Aug 01 16:52:05.577730 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [req-bd582a2f-da8a-4588-8e40-293c63165a0d req-818a0c7b-71ab-4b4e-b2c9-74adf4584e10 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034123 Aug 01 16:52:05.578747 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 546/1078] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:52:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:53:15.068940 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:15.070265 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG dbcounter [-] [118117] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118117) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:15.074411 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_api:SELECT=26 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:15.075064 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-36a57c2d-45d5-4c1c-98de-489bb960f741 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:53:15.075231 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG dbcounter [-] [118118] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118118) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 16:53:15.075948 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-36a57c2d-45d5-4c1c-98de-489bb960f741 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] [instance: f4fff702-385b-4618-ab03-cdce331d1b63] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:53:15.080496 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [req-4342f9ed-2b93-417a-acb0-64dcc97e33bd req-359a090e-3f3b-4714-b03d-160e30138871 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4fff702-385b-4618-ab03-cdce331d1b63", "tag": "c68d7d4a-fd0d-4348-9edf-31e94d52b533"}]} {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:53:15.082277 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-36a57c2d-45d5-4c1c-98de-489bb960f741 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:53:15.082722 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-36a57c2d-45d5-4c1c-98de-489bb960f741 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:53:15.083488 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-36a57c2d-45d5-4c1c-98de-489bb960f741 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:53:15.083979 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-36a57c2d-45d5-4c1c-98de-489bb960f741 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:53:15.094154 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-4342f9ed-2b93-417a-acb0-64dcc97e33bd req-359a090e-3f3b-4714-b03d-160e30138871 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:53:15.094754 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-4342f9ed-2b93-417a-acb0-64dcc97e33bd req-359a090e-3f3b-4714-b03d-160e30138871 service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:53:15.109848 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.compute.server_external_events [req-4342f9ed-2b93-417a-acb0-64dcc97e33bd req-359a090e-3f3b-4714-b03d-160e30138871 service nova] Creating event network-changed:c68d7d4a-fd0d-4348-9edf-31e94d52b533 for instance f4fff702-385b-4618-ab03-cdce331d1b63 on hv-cinder-85032 Aug 01 16:53:15.115198 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-36a57c2d-45d5-4c1c-98de-489bb960f741 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] [instance: f4fff702-385b-4618-ab03-cdce331d1b63] Going to try to terminate instance {{(pid=118117) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 16:53:15.115421 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [req-4342f9ed-2b93-417a-acb0-64dcc97e33bd req-359a090e-3f3b-4714-b03d-160e30138871 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043729 Aug 01 16:53:15.116347 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 547/1079] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:53:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:53:15.205305 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-36a57c2d-45d5-4c1c-98de-489bb960f741 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] 10.222.0.45 "DELETE /compute/v2.1/servers/f4fff702-385b-4618-ab03-cdce331d1b63" status: 204 len: 0 microversion: 2.1 time: 0.138014 Aug 01 16:53:15.206952 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 533/1080] 10.222.0.45 () {58 vars in 1239 bytes} [Mon Aug 1 16:53:15 2022] DELETE /compute/v2.1/servers/f4fff702-385b-4618-ab03-cdce331d1b63 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 16:53:15.216562 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-e9dac486-6604-4730-a55e-a9d8591f85b7 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:53:15.217289 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-e9dac486-6604-4730-a55e-a9d8591f85b7 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] [instance: f4fff702-385b-4618-ab03-cdce331d1b63] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:53:15.224769 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-e9dac486-6604-4730-a55e-a9d8591f85b7 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:53:15.225219 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-e9dac486-6604-4730-a55e-a9d8591f85b7 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:53:15.226000 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-e9dac486-6604-4730-a55e-a9d8591f85b7 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:53:15.226434 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-e9dac486-6604-4730-a55e-a9d8591f85b7 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:53:15.373388 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.policy [None req-e9dac486-6604-4730-a55e-a9d8591f85b7 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc52fbd78dce4bbdada6305efb327264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6154357c0184a0cb61602f2f110b1d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118118) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:53:15.381963 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-e9dac486-6604-4730-a55e-a9d8591f85b7 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] 10.222.0.45 "GET /compute/v2.1/servers/f4fff702-385b-4618-ab03-cdce331d1b63" status: 200 len: 1569 microversion: 2.1 time: 0.170155 Aug 01 16:53:15.382544 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 548/1081] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:53:15 2022] GET /compute/v2.1/servers/f4fff702-385b-4618-ab03-cdce331d1b63 => generated 1569 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:53:16.405059 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-3981e470-2ff7-4d3a-a0ab-91d411acbccb tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:53:16.405718 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-3981e470-2ff7-4d3a-a0ab-91d411acbccb tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] [instance: f4fff702-385b-4618-ab03-cdce331d1b63] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:53:16.412960 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-3981e470-2ff7-4d3a-a0ab-91d411acbccb tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:53:16.413399 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-3981e470-2ff7-4d3a-a0ab-91d411acbccb tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:53:16.414171 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-3981e470-2ff7-4d3a-a0ab-91d411acbccb tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:53:16.414603 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-3981e470-2ff7-4d3a-a0ab-91d411acbccb tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:53:16.558844 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-3981e470-2ff7-4d3a-a0ab-91d411acbccb tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc52fbd78dce4bbdada6305efb327264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6154357c0184a0cb61602f2f110b1d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:53:16.567051 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-3981e470-2ff7-4d3a-a0ab-91d411acbccb tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] 10.222.0.45 "GET /compute/v2.1/servers/f4fff702-385b-4618-ab03-cdce331d1b63" status: 200 len: 1569 microversion: 2.1 time: 0.166675 Aug 01 16:53:16.567655 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 534/1082] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:53:16 2022] GET /compute/v2.1/servers/f4fff702-385b-4618-ab03-cdce331d1b63 => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:53:17.170699 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [req-7e3dae65-451f-4b4f-ab24-f765e108411b req-a532e062-f2e1-451b-8db1-0379eff7416c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4fff702-385b-4618-ab03-cdce331d1b63", "name": "network-vif-deleted", "tag": "c68d7d4a-fd0d-4348-9edf-31e94d52b533"}]} {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 16:53:17.182084 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-7e3dae65-451f-4b4f-ab24-f765e108411b req-a532e062-f2e1-451b-8db1-0379eff7416c service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:53:17.182528 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [req-7e3dae65-451f-4b4f-ab24-f765e108411b req-a532e062-f2e1-451b-8db1-0379eff7416c service nova] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:53:17.194570 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.compute.server_external_events [req-7e3dae65-451f-4b4f-ab24-f765e108411b req-a532e062-f2e1-451b-8db1-0379eff7416c service nova] Creating event network-vif-deleted:c68d7d4a-fd0d-4348-9edf-31e94d52b533 for instance f4fff702-385b-4618-ab03-cdce331d1b63 on hv-cinder-85032 Aug 01 16:53:17.200364 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [req-7e3dae65-451f-4b4f-ab24-f765e108411b req-a532e062-f2e1-451b-8db1-0379eff7416c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033326 Aug 01 16:53:17.200939 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 549/1083] 10.222.0.45 () {64 vars in 1317 bytes} [Mon Aug 1 16:53:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 16:53:17.590950 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-793cf8f2-50e2-408b-b715-f5d77b12dc84 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Calling method '>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:53:17.591647 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.compute.api [None req-793cf8f2-50e2-408b-b715-f5d77b12dc84 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] [instance: f4fff702-385b-4618-ab03-cdce331d1b63] Fetching instance by UUID {{(pid=118117) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:53:17.600997 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-793cf8f2-50e2-408b-b715-f5d77b12dc84 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:53:17.601581 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-793cf8f2-50e2-408b-b715-f5d77b12dc84 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:53:17.602485 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-793cf8f2-50e2-408b-b715-f5d77b12dc84 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:53:17.603110 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-793cf8f2-50e2-408b-b715-f5d77b12dc84 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:53:17.641657 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-793cf8f2-50e2-408b-b715-f5d77b12dc84 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:53:17.642237 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG oslo_concurrency.lockutils [None req-793cf8f2-50e2-408b-b715-f5d77b12dc84 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118117) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:53:17.642753 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.objects.instance [None req-793cf8f2-50e2-408b-b715-f5d77b12dc84 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lazy-loading 'fault' on Instance uuid f4fff702-385b-4618-ab03-cdce331d1b63 {{(pid=118117) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 16:53:17.685854 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.policy [None req-793cf8f2-50e2-408b-b715-f5d77b12dc84 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc52fbd78dce4bbdada6305efb327264', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6154357c0184a0cb61602f2f110b1d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118117) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 16:53:17.693574 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-793cf8f2-50e2-408b-b715-f5d77b12dc84 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] 10.222.0.45 "GET /compute/v2.1/servers/f4fff702-385b-4618-ab03-cdce331d1b63" status: 200 len: 1224 microversion: 2.1 time: 0.108787 Aug 01 16:53:17.694213 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 535/1084] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:53:17 2022] GET /compute/v2.1/servers/f4fff702-385b-4618-ab03-cdce331d1b63 => generated 1224 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 16:53:18.716705 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-28cce1f3-d6de-4b67-aa3f-24e2cc64b924 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Calling method '>' {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:53:18.717396 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.compute.api [None req-28cce1f3-d6de-4b67-aa3f-24e2cc64b924 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] [instance: f4fff702-385b-4618-ab03-cdce331d1b63] Fetching instance by UUID {{(pid=118118) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 16:53:18.724020 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-28cce1f3-d6de-4b67-aa3f-24e2cc64b924 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:53:18.724469 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-28cce1f3-d6de-4b67-aa3f-24e2cc64b924 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:53:18.725230 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-28cce1f3-d6de-4b67-aa3f-24e2cc64b924 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 16:53:18.725661 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG oslo_concurrency.lockutils [None req-28cce1f3-d6de-4b67-aa3f-24e2cc64b924 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Lock "e73af976-0ba6-4137-9c83-d8f1ddc84c77" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118118) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 16:53:18.739825 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.wsgi [None req-28cce1f3-d6de-4b67-aa3f-24e2cc64b924 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] HTTP exception thrown: Instance f4fff702-385b-4618-ab03-cdce331d1b63 could not be found. Aug 01 16:53:18.741601 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-28cce1f3-d6de-4b67-aa3f-24e2cc64b924 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Request method failure captured: Aug 01 16:53:18.741601 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: request: GET /compute/v2.1/servers/f4fff702-385b-4618-ab03-cdce331d1b63 HTTP/1.1 Aug 01 16:53:18.741601 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Accept: application/json Aug 01 16:53:18.741601 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Accept-Encoding: identity Aug 01 16:53:18.741601 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Connection: close Aug 01 16:53:18.741601 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Content-Length: 0 Aug 01 16:53:18.741601 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Content-Type: application/json Aug 01 16:53:18.741601 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Host: 10.222.0.45 Aug 01 16:53:18.741601 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Openstack-System-Scope: None Aug 01 16:53:18.741601 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: User-Agent: python-urllib3/1.26.10 Aug 01 16:53:18.741601 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Auth-Token: gAAAAABi6AP_AMcVbfORpMcO06ec-qTSAvjTZwr2ilh1erT4ZMUbJG330gLO-Ii4Ni3fH9-5CYyt9g5-OcJ_-kNuXrdlf-QrfRJT3y0wmOgCp7MD0q4jQlgXZlkbPzB1MkFdYbPZwFIzwnyoQnYf8OV-2HcUi5qGnQsLxqbpEbYPrZYHJYNFqec Aug 01 16:53:18.741601 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Domain-Id: None Aug 01 16:53:18.741601 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Domain-Name: None Aug 01 16:53:18.741601 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Identity-Status: Confirmed Aug 01 16:53:18.741601 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Is-Admin-Project: True Aug 01 16:53:18.741601 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Domain-Id: default Aug 01 16:53:18.741601 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Domain-Name: Default Aug 01 16:53:18.741601 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Id: b6154357c0184a0cb61602f2f110b1d7 Aug 01 16:53:18.741601 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Project-Name: tempest-TestShelveInstance-677112017 Aug 01 16:53:18.741601 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Role: reader,member Aug 01 16:53:18.741601 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Roles: reader,member Aug 01 16:53:18.743463 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.45:8080", "publicURL": "http://10.222.0.45:8080/v1/AUTH_b6154357c0184a0cb61602f2f110b1d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/b6154357c0184a0cb61602f2f110b1d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b6154357c0184a0cb61602f2f110b1d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b6154357c0184a0cb61602f2f110b1d7"}]}] Aug 01 16:53:18.743463 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant: tempest-TestShelveInstance-677112017 Aug 01 16:53:18.743463 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant-Id: b6154357c0184a0cb61602f2f110b1d7 Aug 01 16:53:18.743463 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-Tenant-Name: tempest-TestShelveInstance-677112017 Aug 01 16:53:18.743463 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User: tempest-TestShelveInstance-677112017-project Aug 01 16:53:18.743463 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Domain-Id: default Aug 01 16:53:18.743463 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Domain-Name: Default Aug 01 16:53:18.743463 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Id: cc52fbd78dce4bbdada6305efb327264 Aug 01 16:53:18.743463 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: X-User-Name: tempest-TestShelveInstance-677112017-project Aug 01 16:53:18.743463 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: method: > Aug 01 16:53:18.743463 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: exception: Instance f4fff702-385b-4618-ab03-cdce331d1b63 could not be found. Aug 01 16:53:18.743463 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: action_args: {'id': 'f4fff702-385b-4618-ab03-cdce331d1b63'} Aug 01 16:53:18.745042 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: {{(pid=118118) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 16:53:18.745042 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:53:18.745042 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 16:53:18.745042 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 16:53:18.745042 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 16:53:18.745042 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 16:53:18.745042 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 16:53:18.745042 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 16:53:18.745042 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 16:53:18.745042 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 16:53:18.745042 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4fff702-385b-4618-ab03-cdce331d1b63 could not be found. Aug 01 16:53:18.745042 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:53:18.745042 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:53:18.745042 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:53:18.745042 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:53:18.745042 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:53:18.745042 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:53:18.745042 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 16:53:18.745042 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 16:53:18.745042 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 16:53:18.746784 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 16:53:18.746784 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 16:53:18.746784 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 16:53:18.746784 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 16:53:18.746784 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 16:53:18.746784 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 16:53:18.746784 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 16:53:18.746784 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4fff702-385b-4618-ab03-cdce331d1b63 could not be found. Aug 01 16:53:18.746784 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:53:18.746784 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 16:53:18.746784 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:53:18.746784 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 16:53:18.746784 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 16:53:18.746784 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 16:53:18.746784 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 16:53:18.746784 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 16:53:18.746784 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4fff702-385b-4618-ab03-cdce331d1b63 could not be found. Aug 01 16:53:18.746784 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: ERROR nova.api.openstack.wsgi Aug 01 16:53:18.748332 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: DEBUG nova.api.openstack.wsgi [None req-28cce1f3-d6de-4b67-aa3f-24e2cc64b924 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Returning 404 to user: Instance f4fff702-385b-4618-ab03-cdce331d1b63 could not be found. {{(pid=118118) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 16:53:18.748332 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO nova.api.openstack.requestlog [None req-28cce1f3-d6de-4b67-aa3f-24e2cc64b924 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] 10.222.0.45 "GET /compute/v2.1/servers/f4fff702-385b-4618-ab03-cdce331d1b63" status: 404 len: 111 microversion: 2.1 time: 0.031383 Aug 01 16:53:18.748332 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: [pid: 118118|app: 0|req: 550/1085] 10.222.0.45 () {58 vars in 1236 bytes} [Mon Aug 1 16:53:18 2022] GET /compute/v2.1/servers/f4fff702-385b-4618-ab03-cdce331d1b63 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 16:53:18.918608 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: DEBUG nova.api.openstack.wsgi [None req-d69b8349-04f3-41ad-9482-70cb5328ff33 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] Calling method '.version_select at 0x7efd5ea984c0>' {{(pid=118117) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 16:53:18.941566 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO nova.api.openstack.requestlog [None req-d69b8349-04f3-41ad-9482-70cb5328ff33 tempest-TestShelveInstance-677112017 tempest-TestShelveInstance-677112017-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2053706543" status: 202 len: 0 microversion: 2.1 time: 0.026927 Aug 01 16:53:18.942224 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: [pid: 118117|app: 0|req: 536/1086] 10.222.0.45 () {58 vars in 1254 bytes} [Mon Aug 1 16:53:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2053706543 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 16:54:14.211528 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 16:54:14.212322 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Mon Aug 1 16:54:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 16:54:36.793542 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 16:54:36.794254 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Mon Aug 1 16:54:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 16:55:18.286507 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 16:55:18.287271 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Mon Aug 1 16:55:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 16:55:55.328931 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 16:55:55.329618 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Mon Aug 1 16:55:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 16:56:18.391742 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 16:56:18.392419 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Mon Aug 1 16:56:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 16:57:34.221882 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 16:57:34.222621 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Mon Aug 1 16:57:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 16:57:56.803185 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 16:57:56.803869 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Mon Aug 1 16:57:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 16:58:16.666408 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 16:58:16.666408 dv-cinder-850321-2-iscsi devstack@n-api.service[118117]: Mon Aug 1 16:58:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 16:58:38.295844 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 16:58:38.296467 dv-cinder-850321-2-iscsi devstack@n-api.service[118118]: Mon Aug 1 16:58:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!